00000100:00100000:2.0F:1788263473.404418:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263473.404457:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753773056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263473.404527:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263473.404601:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753773056 00000100:00100000:2.0:1788263473.404609:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753773056 00000100:00100000:2.0:1788263473.404669:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788263473.404678:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753773056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263473.404717:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263473.404763:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753773056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263473.404770:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788263473.404792:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788263473.404829:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753773056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0F:1788263473.406390:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753773312:0@lo:400:kworker.0 00000100:00100000:0.0:1788263473.406459:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263473.406504:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788263473.406512:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753773440:0@lo:400:kworker.0 00000100:00100000:0.0:1788263473.406535:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263473.406562:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753773312 00000100:00100000:0.0:1788263473.406568:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753773312 00000100:00100000:0.0:1788263473.406612:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788263473.406620:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753773312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263473.406661:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753773312:12345-0@lo:400:kworker.0 Request processed in 42us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263473.406667:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788263473.406702:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753773312:0@lo:400:kworker.0 00000100:00080000:2.0:1788263473.406787:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263473.406801:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753773184:0@lo:400:kworker.0 00000100:00100000:2.0:1788263473.406833:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263473.406869:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753773696:0@lo:400:kworker.0 00000100:00100000:2.0:1788263473.406892:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263473.406911:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263473.406916:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753773568:0@lo:400:kworker.0 00000100:00100000:2.0:1788263473.406937:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263473.406962:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753773440 00000100:00100000:2.0:1788263473.406967:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753773440 00000100:00100000:2.0:1788263473.406990:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753773696 00000100:00100000:2.0:1788263473.406992:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753773696 00000100:00100000:2.0:1788263473.407011:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753773568 00000100:00100000:2.0:1788263473.407026:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753773568 00000100:00100000:2.0:1788263473.407045:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788263473.407051:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753773440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263473.407097:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753773440:12345-0@lo:400:kworker.0 Request processed in 46us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263473.407104:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788263473.407132:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263473.407139:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753773696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263473.407171:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753773696:12345-0@lo:400:kworker.0 Request processed in 33us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263473.407176:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788263473.407188:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788263473.407194:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753773568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263473.407245:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753773568:12345-0@lo:400:kworker.0 Request processed in 51us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263473.407251:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788263473.407265:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263473.407281:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753773440:0@lo:400:kworker.0 00000100:00100000:2.0:1788263473.407300:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753773568:0@lo:400:kworker.0 00000100:00100000:2.0:1788263473.407309:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753773696:0@lo:400:kworker.0 00000100:00100000:0.0:1788263473.411392:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753773184 00000100:00100000:0.0:1788263473.411406:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753773184 00000100:00100000:0.0:1788263473.411465:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788263473.411477:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753773184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263473.411583:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753773184:12345-0@lo:400:kworker.0 Request processed in 108us (4748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263473.411592:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788263473.411650:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753773184:0@lo:400:kworker.0 00000001:00080000:3.0F:1788263473.452299:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000020:00080000:3.0:1788263473.452326:0:5874:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9943469f7b40 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:3.0:1788263473.452332:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994350de4a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff994380c86a80 00000020:00080000:3.0:1788263473.452336:0:5874:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff994350de4100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff994243687c00 00000001:00080000:3.0:1788263473.452368:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:0.0:1788263473.452432:0:14535:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:0.0:1788263473.452653:0:14535:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788263473.469463:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263474.492803:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0F:1788263474.983377:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263474.983462:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735968640 00000100:00100000:2.0:1788263474.983473:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735968640 00000100:00100000:2.0:1788263474.983553:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:2.0:1788263474.983564:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+12:14428:x1875129735968640:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788263474.983665:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+12:14428:x1875129735968640:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 Request processed in 104us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263474.983682:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00080000:3.0:1788263474.983850:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263474.991723:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263474.991794:0:14501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735968896 00000100:00100000:1.0:1788263474.991805:0:14501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735968896 00000100:00100000:1.0:1788263474.991866:0:14501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788263474.991876:0:14501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+12:14428:x1875129735968896:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788263474.992166:0:14501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+13:14428:x1875129735968896:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 290us (451us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788263474.992176:0:14501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788263475.451508:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263475.451689:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753773824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263475.451758:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263475.451879:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753773824 00000100:00100000:2.0:1788263475.451887:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753773824 00000100:00100000:2.0:1788263475.451941:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788263475.451950:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753773824:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788263475.452042:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788263475.452347:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788263475.452408:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753773824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 458us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263475.452415:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263475.452742:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753773824:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263475.515456:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263476.540119:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263476.984065:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263476.984108:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263476.984139:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263476.984169:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263476.984185:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263476.984202:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263476.984275:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735969024 00000100:00100000:1.0:1788263476.984286:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735969024 00000100:00100000:3.0:1788263476.984290:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735969152 00000100:00100000:3.0:1788263476.984294:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735969152 00000100:00100000:1.0:1788263476.984336:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:3.0:1788263476.984340:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1788263476.984346:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2361:x1875129735969024:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263476.984347:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+13:2361:x1875129735969152:12345-192.168.201.29@tcp:400:kworker.0 00000100:00080000:2.0:1788263476.984423:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263476.984553:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+13:2361:x1875129735969152:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 205us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.984561:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:3.0:1788263476.984594:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735969280 00000100:00100000:3.0:1788263476.984598:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735969280 00000100:00100000:3.0:1788263476.984624:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735969408 00000100:00100000:3.0:1788263476.984627:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735969408 00000100:00100000:3.0:1788263476.984640:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735969664 00000100:00100000:3.0:1788263476.984642:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735969664 00000100:00100000:3.0:1788263476.984654:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735969792 00000100:00100000:3.0:1788263476.984656:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735969792 00000100:00100000:3.0:1788263476.984669:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:3.0:1788263476.984675:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2361:x1875129735969280:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263476.985703:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788263476.985732:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437ab04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2358:x1875129735969408:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:0.0:1788263476.985775:0:16378:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956efc 00000100:00080000:0.0:1788263476.985792:0:16378:0:(import.c:65:import_set_state_nolock()) ffff9943803ec800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788263476.985834:0:16378:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788263476.986180:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2361:x1875129735969024:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 1832us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.986191:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:1.0:1788263476.986255:0:15184:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788263476.986263:0:15184:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788263476.986278:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788263476.986286:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788263476.986293:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2358:x1875129735969664:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:1.0:1788263476.986306:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956f2d 00000100:00080000:1.0:1788263476.986316:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9943803e8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788263476.986338:0:15183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:1.0:1788263476.986502:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+2:2358:x1875129735969664:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 208us (2314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.986509:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788263476.986523:0:15183:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788263476.986529:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:1.0:1788263476.986536:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+5:2358:x1875129735969792:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:1.0:1788263476.986549:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956f34 00000100:00080000:1.0:1788263476.986556:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9943803e2000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788263476.986569:0:15183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788263476.986636:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+2:2358:x1875129735969792:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 99us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263476.986642:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00010000:00010000:1.0:1788263476.986741:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263476.987983:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263476.993561:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2361:x1875129735969280:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 8874us (9440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.993576:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00080000:3.0:1788263476.993634:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263476.993640:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263476.993912:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263476.994274:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735969536 00000100:00100000:3.0:1788263476.994287:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735969536 00000100:00100000:3.0:1788263476.998552:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:3.0:1788263476.998569:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2362:x1875129735969536:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263476.998657:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2362:x1875129735969536:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 93us (4746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263476.998666:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:0.0:1788263476.999506:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437ab04450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+2:2358:x1875129735969408:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 13788us (15331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263476.999516:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00080000:1.0:1788263477.002399:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788263477.563397:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263478.532971:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753774336:0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533075:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263478.533134:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788263478.533141:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753773952:0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533171:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263478.533194:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753774464:0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533243:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263478.533272:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753774208:0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533296:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263478.533314:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788263478.533318:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753774080:0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533337:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263478.533351:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753774592:0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533369:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263478.533395:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753774336 00000100:00100000:0.0:1788263478.533402:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753774336 00000100:00100000:0.0:1788263478.533436:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753774464 00000100:00100000:0.0:1788263478.533438:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753774464 00000100:00100000:0.0:1788263478.533461:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753774592 00000100:00100000:0.0:1788263478.533464:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753774592 00000100:00100000:0.0:1788263478.533506:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788263478.533514:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753774336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533565:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753774336:12345-0@lo:400:kworker.0 Request processed in 52us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.533573:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788263478.533590:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788263478.533596:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753774464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533623:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753774464:12345-0@lo:400:kworker.0 Request processed in 28us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.533629:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788263478.533640:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263478.533646:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753774592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533675:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753774592:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.533681:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788263478.533697:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753773952 00000100:00100000:0.0:1788263478.533700:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753773952 00000100:00100000:0.0:1788263478.533722:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788263478.533727:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3320:x1875129753773952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533755:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3320:x1875129753773952:12345-0@lo:400:kworker.0 Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.533761:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788263478.533805:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753773952:0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533817:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753774464:0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533824:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753774336:0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.533866:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753774592:0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.535270:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753774208 00000100:00100000:0.0:1788263478.535283:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753774208 00000100:00100000:0.0:1788263478.535330:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753774080 00000100:00100000:0.0:1788263478.535333:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753774080 00000100:00100000:0.0:1788263478.535355:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263478.535363:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753774208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.535433:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753774208:12345-0@lo:400:kworker.0 Request processed in 70us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.535440:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788263478.535453:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263478.535459:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753774080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.535484:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753774080:12345-0@lo:400:kworker.0 Request processed in 26us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.535489:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263478.535547:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753774080:0@lo:400:kworker.0 00000100:00100000:0.0:1788263478.535558:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753774208:0@lo:400:kworker.0 00000100:00080000:1.0:1788263478.536090:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788263478.536096:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263478.536099:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263478.545066:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753774720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263478.545137:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263478.545192:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753774720 00000100:00100000:0.0:1788263478.545200:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753774720 00000100:00100000:0.0:1788263478.545262:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788263478.545271:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753774720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263478.545302:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263478.545343:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753774720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263478.545357:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788263478.545404:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753774720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788263478.594917:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788263478.624791:0:5874:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000001:00080000:2.0:1788263478.624815:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1788263478.624827:0:14535:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:2.0:1788263478.624836:0:14535:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000001:00100000:0.0:1788263478.687209:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aaa94f48-2848-4430-a76d-a41ea14a2177 00000020:00000080:0.0:1788263478.687236:0:7662:0:(genops.c:885:class_export_put()) final put ffff9943803ec000/aaa94f48-2848-4430-a76d-a41ea14a2177 00000001:00100000:0.0:1788263478.687259:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03b4c7a6-bb3d-4ac1-a18b-dbce72656187 00000020:00000080:0.0:1788263478.687262:0:7662:0:(genops.c:885:class_export_put()) final put ffff9943803e2800/03b4c7a6-bb3d-4ac1-a18b-dbce72656187 00000020:00000080:0.0:1788263478.687290:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803ec000/aaa94f48-2848-4430-a76d-a41ea14a2177 for lustre-OST0001 00000020:00000080:0.0:1788263478.687339:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803e2800/03b4c7a6-bb3d-4ac1-a18b-dbce72656187 for lustre-OST0001 00000020:00000080:0.0:1788263478.687352:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9943803ec800 for lustre-OST0001 00000020:00000080:0.0:1788263478.687357:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9943803e2000 for lustre-OST0001 00000001:00100000:3.0:1788263479.116437:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03b4c7a6-bb3d-4ac1-a18b-dbce72656187 00000020:00000080:3.0:1788263479.116449:0:6729:0:(genops.c:885:class_export_put()) final put ffff9943803ee800/03b4c7a6-bb3d-4ac1-a18b-dbce72656187 00000020:00000080:1.0:1788263479.116730:0:492:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803ee800/03b4c7a6-bb3d-4ac1-a18b-dbce72656187 for lustre-OST0000 00000020:00000080:1.0:1788263479.116783:0:492:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9943803e8000 for lustre-OST0000 00010000:00010000:1.0:1788263479.612332:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263480.571494:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263480.571519:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753774848:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788263480.571590:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263480.571657:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753774848 00000100:00100000:0.0:1788263480.571664:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753774848 00000100:00100000:0.0:1788263480.571713:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788263480.571722:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753774848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788263480.571758:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788263480.571801:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753774848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263480.571809:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788263480.571829:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263480.571865:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753774848:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788263480.636609:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263481.344874:0:14531:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788263481.344883:0:14531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263481.345188:0:14531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788263481.345197:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788263481.659513:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263482.094511:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263482.094558:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263482.094602:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263482.094649:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263482.094682:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735969920 00000100:00100000:2.0:1788263482.094693:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735969920 00000100:00100000:2.0:1788263482.094745:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:2.0:1788263482.094769:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2360:x1875129735969920:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263482.094854:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2360:x1875129735969920:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 99us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263482.094873:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:2.0:1788263482.094909:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735970048 00000100:00100000:2.0:1788263482.094913:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735970048 00000100:00100000:2.0:1788263482.094952:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735970304 00000100:00100000:2.0:1788263482.094955:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735970304 00000100:00100000:2.0:1788263482.094985:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:2.0:1788263482.094994:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+12:2359:x1875129735970048:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263482.095044:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+12:2359:x1875129735970048:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 52us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263482.095050:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:2.0:1788263482.095062:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:2.0:1788263482.095068:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2359:x1875129735970304:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263482.095095:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2359:x1875129735970304:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263482.095102:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:2.0:1788263482.095121:0:16378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735970176 00000100:00100000:2.0:1788263482.095124:0:16378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735970176 00000100:00100000:2.0:1788263482.095150:0:16378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1788263482.095167:0:16378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2360:x1875129735970176:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263482.095195:0:16378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2360:x1875129735970176:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 32us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263482.095201:0:16378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00080000:2.0:1788263482.095254:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263482.095259:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788263482.683487:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263483.646689:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753774976:0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.646762:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263483.646804:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753775488:0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.646826:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263483.646848:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263483.646853:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753775360:0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.646874:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263483.646898:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753775104:0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.646921:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263483.646948:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753775616:0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.647127:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263483.647149:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788263483.647155:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943473dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753775232:0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.647180:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263483.647214:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753774976 00000100:00100000:0.0:1788263483.647249:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753774976 00000100:00100000:0.0:1788263483.647291:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788263483.647299:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3321:x1875129753774976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.647343:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438129b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3321:x1875129753774976:12345-0@lo:400:kworker.0 Request processed in 44us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263483.647350:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788263483.647379:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753775488 00000100:00100000:0.0:1788263483.647383:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753775488 00000100:00100000:0.0:1788263483.647408:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753775360 00000100:00100000:0.0:1788263483.647410:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753775360 00000100:00100000:0.0:1788263483.647419:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753775616 00000100:00100000:0.0:1788263483.647421:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753775616 00000100:00100000:0.0:1788263483.647432:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263483.647446:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753775488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.647477:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753775488:12345-0@lo:400:kworker.0 Request processed in 33us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263483.647483:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263483.647494:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263483.647499:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753775360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.647519:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753775360:12345-0@lo:400:kworker.0 Request processed in 20us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263483.647523:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263483.647533:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263483.647539:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753775616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.647564:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753775616:12345-0@lo:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263483.647570:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788263483.647590:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753775104 00000100:00100000:0.0:1788263483.647594:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753775104 00000100:00100000:0.0:1788263483.647619:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753775232 00000100:00100000:0.0:1788263483.647622:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753775232 00000100:00100000:0.0:1788263483.647643:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263483.647649:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753775104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.647677:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753775104:12345-0@lo:400:kworker.0 Request processed in 29us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263483.647683:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788263483.647693:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788263483.647698:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753775232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.647722:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753775232:12345-0@lo:400:kworker.0 Request processed in 24us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263483.647736:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788263483.647759:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788263483.647763:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788263483.647765:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788263483.651298:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753775744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263483.651373:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263483.651426:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753775744 00000100:00100000:0.0:1788263483.651434:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753775744 00000100:00100000:0.0:1788263483.651478:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788263483.651488:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753775744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263483.651526:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263483.651571:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753775744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263483.651578:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788263483.651630:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753775744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263483.651665:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753775232:0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.651677:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753775104:0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.651687:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753775616:0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.651722:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753775360:0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.651733:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753774976:0@lo:400:kworker.0 00000100:00100000:0.0:1788263483.651744:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943473dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753775488:0@lo:400:kworker.0 00010000:00010000:2.0:1788263483.708802:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263484.731457:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263485.691467:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753775872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263485.691574:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263485.691763:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753775872 00000100:00100000:2.0:1788263485.691777:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753775872 00000100:00100000:2.0:1788263485.691877:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788263485.691891:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753775872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263485.691953:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00080000:3.0:1788263485.692048:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263485.698034:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753775872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6131us (6446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263485.698053:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788263485.710787:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753775872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788263485.755601:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263486.783359:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788263486.918760:0:17443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 07:51:25 (1788263485) 00000100:00100000:2.0:1788263487.215120:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263487.215245:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263487.215272:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263487.215578:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735970432 00000100:00100000:1.0:1788263487.215588:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735970432 00000100:00100000:1.0:1788263487.215637:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:1.0:1788263487.215649:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2361:x1875129735970432:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263487.215723:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438129ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2361:x1875129735970432:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 76us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263487.215731:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:2.0:1788263487.215884:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263487.216282:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735970688 00000100:00100000:2.0:1788263487.216287:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735970688 00000100:00100000:2.0:1788263487.216333:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:2.0:1788263487.216353:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2361:x1875129735970688:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263487.216394:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2361:x1875129735970688:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 43us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263487.216401:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00080000:2.0:1788263487.216418:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263487.217070:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735970560 00000100:00100000:3.0:1788263487.217078:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735970560 00000100:00100000:1.0:1788263487.217133:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735970816 00000100:00100000:1.0:1788263487.217138:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735970816 00000100:00100000:3.0:1788263487.217191:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:3.0:1788263487.217201:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+12:2362:x1875129735970560:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263487.217272:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aaa94f48-2848-4430-a76d-a41ea14a2177+12:2362:x1875129735970560:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 74us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263487.217279:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00080000:2.0:1788263487.217614:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263487.217738:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:1.0:1788263487.217746:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2362:x1875129735970816:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788263487.217774:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2362:x1875129735970816:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 30us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263487.217791:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00010000:00010000:0.0:1788263487.809101:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263488.771522:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753776384:0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.771596:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263488.771657:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788263488.771664:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753776000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263488.772046:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263488.772072:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753776512:0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.772097:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263488.772126:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753776128:0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.772155:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263488.772179:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753776640:0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.772203:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263488.772247:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788263488.772254:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753776256:0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.772276:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263488.772294:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753776768:0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.772316:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263488.772349:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753776384 00000100:00100000:2.0:1788263488.772355:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753776384 00000100:00100000:2.0:1788263488.772404:0:15184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753776256 00000100:00100000:2.0:1788263488.772414:0:15184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753776256 00000100:00100000:2.0:1788263488.772440:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263488.772449:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753776384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.772499:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753776384:12345-0@lo:400:kworker.0 Request processed in 51us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263488.772506:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263488.772522:0:15184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263488.772530:0:15184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753776256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.772562:0:15184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753776256:12345-0@lo:400:kworker.0 Request processed in 34us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263488.772568:0:15184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788263488.772586:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753776128 00000100:00100000:2.0:1788263488.772589:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753776128 00000100:00100000:2.0:1788263488.772615:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788263488.772620:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3322:x1875129753776128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.772648:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3322:x1875129753776128:12345-0@lo:400:kworker.0 Request processed in 28us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263488.772654:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788263488.772679:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753776512 00000100:00100000:2.0:1788263488.772683:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753776512 00000100:00100000:2.0:1788263488.775363:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753776640 00000100:00100000:2.0:1788263488.775377:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753776640 00000100:00100000:2.0:1788263488.775406:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753776768 00000100:00100000:2.0:1788263488.775409:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753776768 00000100:00100000:2.0:1788263488.775432:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788263488.775442:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753776512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.775525:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753776512:12345-0@lo:400:kworker.0 Request processed in 85us (3427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263488.775542:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788263488.775560:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788263488.775567:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753776640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.775599:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753776640:12345-0@lo:400:kworker.0 Request processed in 33us (3396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263488.775605:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788263488.775617:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788263488.775623:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753776768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.775651:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753776768:12345-0@lo:400:kworker.0 Request processed in 28us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263488.775656:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788263488.775685:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788263488.775701:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263488.775704:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263488.777900:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753776000 00000100:00100000:1.0:1788263488.777921:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753776000 00000100:00100000:1.0:1788263488.777996:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788263488.778010:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753776000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263488.778068:0:15186:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263488.778073:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753776256:0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.778110:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753776768:0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.778124:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:91f17ece-9654-41b2-8823-2d6af9d5176a:3322:1875129753776128:0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.778137:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753776640:0@lo:400:kworker.0 00000100:00100000:1.0:1788263488.778187:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753776000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (6492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263488.778196:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263488.778267:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753776000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263488.778283:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753776512:0@lo:400:kworker.0 00000100:00100000:2.0:1788263488.778292:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753776384:0@lo:400:kworker.0 00010000:00010000:3.0:1788263488.828996:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263489.852134:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263490.812383:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753776896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263490.812487:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263490.812626:0:15185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753776896 00000100:00100000:3.0:1788263490.812635:0:15185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753776896 00000100:00100000:3.0:1788263490.812707:0:15185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263490.812719:0:15185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753776896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263490.812756:0:15185:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00080000:1.0:1788263490.813154:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263490.813175:0:15185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753776896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 456us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263490.813192:0:15185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788263490.813578:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753776896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788263490.875558:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263491.192994:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263491.193212:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735971072 00000100:00100000:3.0:1788263491.193265:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735971072 00000100:00100000:3.0:1788263491.193538:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788263491.193551:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+12:15310:x1875129735971072:12345-192.168.201.29@tcp:35:umount.0 00000001:00080000:3.0:1788263491.193920:0:14500:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:3.0:1788263491.194641:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+14:15310:x1875129735971072:12345-192.168.201.29@tcp:35:umount.0 Request processed in 1086us (1650us total) trans 8589934625 rc 0/0 00000100:00100000:3.0:1788263491.194652:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000020:00080000:3.0:1788263491.194658:0:14500:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1788263491.195001:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263491.199529:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263491.199643:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263491.206796:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263491.206961:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735971200 00000100:00100000:0.0:1788263491.206971:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735971200 00000100:00100000:0.0:1788263491.207087:0:14483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735971328 00000100:00100000:0.0:1788263491.207092:0:14483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735971328 00000100:00100000:1.0:1788263491.207444:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263491.207473:0:15182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735971584 00000100:00100000:1.0:1788263491.207477:0:15182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735971584 00000100:00100000:1.0:1788263491.207520:0:15182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:1.0:1788263491.207530:0:15182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+5:2358:x1875129735971584:12345-192.168.201.29@tcp:9:umount.0 00000020:00000080:1.0:1788263491.207563:0:15182:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956ef5 00000100:00080000:1.0:1788263491.207572:0:15182:0:(import.c:65:import_set_state_nolock()) ffff9942435e8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788263491.207608:0:15182:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:1.0:1788263491.207884:0:15182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+2:2358:x1875129735971584:12345-192.168.201.29@tcp:9:umount.0 Request processed in 354us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263491.207891:0:15182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00010000:00010000:1.0:1788263491.207910:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788263491.207917:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788263491.208895:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735971456 00000100:00100000:3.0:1788263491.208905:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735971456 00000100:00100000:3.0:1788263491.208944:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1788263491.208953:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+15:2360:x1875129735971200:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263491.208964:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263491.208983:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216c600/0x1a657bc513956ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33ed expref: 15 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.208998:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263491.209061:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+14:2360:x1875129735971200:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 95us (9529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263491.209068:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1788263491.209086:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788263491.209093:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+13:2360:x1875129735971328:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263491.209102:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263491.209127:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994242899400/0x1a657bc513956ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3417 expref: 13 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.209136:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263491.209155:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ec0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+12:2360:x1875129735971328:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 63us (9513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263491.209162:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788263491.209208:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788263491.209236:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:2360:x1875129735971456:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263491.209246:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263491.209256:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d6a00/0x1a657bc513956f81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34b8 expref: 11 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.209265:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263491.209282:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:2360:x1875129735971456:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 68us (2496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263491.209288:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788263491.217615:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263491.217707:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735972480 00000100:00100000:2.0:1788263491.217718:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735972480 00000100:00100000:2.0:1788263491.217781:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:2.0:1788263491.217792:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+14:2358:x1875129735972480:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:2.0:1788263491.217835:0:14497:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956eee 00000020:00010000:2.0:1788263491.217851:0:14497:0:(genops.c:1921:obd_stale_export_put()) Put export ffff994243364000: total 0 00000100:00080000:2.0:1788263491.217855:0:14497:0:(import.c:65:import_set_state_nolock()) ffff994241ada000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788263491.217884:0:14497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:2.0:1788263491.218470:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aaa94f48-2848-4430-a76d-a41ea14a2177+13:2358:x1875129735972480:12345-192.168.201.29@tcp:39:umount.0 Request processed in 676us (860us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1788263491.218479:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000020:00010000:3.0:1788263491.219309:0:14486:0:(genops.c:1907:obd_stale_export_get()) Get export ffff994243364000: total 0 00010000:00010000:3.0:1788263491.219314:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263491.219353:0:14486:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994243364000, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788263491.219388:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff994352cd3a00) 00010000:00010000:3.0:1788263491.219392:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263491.219401:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc513956fb9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34c6 expref: 12 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.219424:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3700) 00010000:00010000:3.0:1788263491.219426:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263491.219430:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513956ff1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34d4 expref: 11 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.219461:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99434314f900) 00010000:00010000:3.0:1788263491.219464:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263491.219468:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6400/0x1a657bc513956f9d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34bf expref: 10 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.219484:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99434314f200) 00010000:00010000:3.0:1788263491.219486:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788263491.219490:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d6000/0x1a657bc513957172 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d354b expref: 9 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.219503:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99434314fc00) 00010000:00010000:3.0:1788263491.219505:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788263491.219509:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158000/0x1a657bc513957076 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34fe expref: 8 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.219522:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:3.0:1788263491.219524:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263491.219527:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7000/0x1a657bc513957117 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3536 expref: 7 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.219537:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9943435a7300) 00010000:00010000:3.0:1788263491.219539:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788263491.219543:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc5139570f4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3528 expref: 6 pid: 14497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263491.219554:0:14486:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994243364000, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788263491.219566:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263491.219573:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263491.219575:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263491.579508:0:14531:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788263491.579516:0:14531:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263491.579539:0:14531:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788263491.579545:0:14531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788263491.900959:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263492.336692:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263492.336748:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263492.336861:0:14492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735972608 00000100:00100000:0.0:1788263492.336871:0:14492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735972608 00000100:00100000:0.0:1788263492.336930:0:14492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:0.0:1788263492.336940:0:14492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:2359:x1875129735972608:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788263492.337018:0:14492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:2359:x1875129735972608:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 80us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263492.337027:0:14492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:3.0:1788263492.337142:0:14498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735972736 00000100:00100000:3.0:1788263492.337147:0:14498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735972736 00000100:00100000:3.0:1788263492.337207:0:14498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:3.0:1788263492.337263:0:14498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437630fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2359:x1875129735972736:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263492.337298:0:14498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437630fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2359:x1875129735972736:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 84us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263492.337305:0:14498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00080000:2.0:1788263492.337393:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263492.650123:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263492.650168:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263492.653707:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735972864 00000100:00100000:3.0:1788263492.653722:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735972864 00000100:00100000:3.0:1788263492.653809:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735972992 00000100:00100000:3.0:1788263492.653813:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735972992 00000100:00100000:3.0:1788263492.653836:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788263492.653845:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+11:2361:x1875129735972864:12345-192.168.201.29@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788263492.653861:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:3.0:1788263492.653868:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263492.653887:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994242899e00/0x1a657bc513956f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d344f expref: 11 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.653904:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263492.653959:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:2361:x1875129735972864:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 115us (3845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263492.653968:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788263492.653983:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735973120 00000100:00100000:3.0:1788263492.653987:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735973120 00000100:00100000:3.0:1788263492.654002:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788263492.654007:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+10:2361:x1875129735972992:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263492.654014:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263492.654035:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216d400/0x1a657bc513956f18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3479 expref: 10 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.654046:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263492.654078:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+9:2361:x1875129735972992:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 70us (3910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263492.654085:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788263492.654098:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788263492.654105:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+8:2362:x1875129735973120:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263492.654112:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263492.654121:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994343159e00/0x1a657bc513956f7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34b1 expref: 8 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263492.654129:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263492.654146:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5b43f238-23cd-4921-93f7-57aed6f2c2c6+7:2362:x1875129735973120:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 42us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263492.654152:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1788263492.667856:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263492.668143:0:14497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735973376 00000100:00100000:2.0:1788263492.668154:0:14497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735973376 00000100:00100000:2.0:1788263492.670066:0:14497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:2.0:1788263492.670086:0:14497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+6:2358:x1875129735973376:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:2.0:1788263492.670126:0:14497:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956f26 00000020:00010000:2.0:1788263492.670136:0:14497:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9942435e9800: total 0 00000100:00080000:2.0:1788263492.670141:0:14497:0:(import.c:65:import_set_state_nolock()) ffff9942435eb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788263492.670176:0:14497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:0.0:1788263492.670200:0:14486:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9942435e9800: total 0 00010000:00010000:0.0:1788263492.670258:0:14486:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9942435e9800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788263492.670291:0:14486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff994352cd3700) 00010000:00010000:0.0:1788263492.670294:0:14486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263492.670302:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9943810d7c00/0x1a657bc513956fff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d34db expref: 6 pid: 14498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263492.670322:0:14486:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9942435e9800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788263492.670332:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263492.670334:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263492.670336:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263492.670408:0:14497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03b4c7a6-bb3d-4ac1-a18b-dbce72656187+3:2358:x1875129735973376:12345-192.168.201.29@tcp:39:umount.0 Request processed in 329us (2560us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1788263492.670417:0:14497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:1.0:1788263492.691423:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263492.692192:0:14490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735973632 00000100:00100000:2.0:1788263492.692205:0:14490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735973632 00000100:00100000:2.0:1788263492.692318:0:14490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 132 00000100:00100000:2.0:1788263492.692328:0:14490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+7:2358:x1875129735973632:12345-192.168.201.29@tcp:251:umount.0 00000020:00000080:2.0:1788263492.692374:0:14490:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956ecb 00000020:00010000:2.0:1788263492.692383:0:14490:0:(genops.c:1921:obd_stale_export_put()) Put export ffff994243361000: total 0 00000100:00080000:2.0:1788263492.692387:0:14490:0:(import.c:65:import_set_state_nolock()) ffff994243367000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788263492.692463:0:14490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5b43f238-23cd-4921-93f7-57aed6f2c2c6+3:2358:x1875129735973632:12345-192.168.201.29@tcp:251:umount.0 Request processed in 136us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263492.692471:0:14490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 132 00000020:00010000:1.0:1788263492.692859:0:14485:0:(genops.c:1907:obd_stale_export_get()) Get export ffff994243361000: total 0 00010000:00010000:1.0:1788263492.692863:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263492.692905:0:14485:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff994243361000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788263492.692937:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994242899200/0x1a657bc513956ed2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d33e6 expref: 2 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263492.692969:0:14485:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff994243361000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788263492.692979:0:14485:0:(genops.c:885:class_export_put()) final put ffff994243361000/5b43f238-23cd-4921-93f7-57aed6f2c2c6 00010000:00010000:1.0:1788263492.692994:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263492.692997:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263492.693007:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788263492.695280:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994243361000/5b43f238-23cd-4921-93f7-57aed6f2c2c6 for MGS 00000020:00000080:2.0:1788263492.695327:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994243367000 for MGS 00010000:00010000:0.0:1788263492.930740:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263493.885393:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263493.885414:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753777024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263493.885483:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263493.885646:0:15186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753777024 00000100:00100000:1.0:1788263493.885653:0:15186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753777024 00000100:00100000:1.0:1788263493.885704:0:15186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788263493.885714:0:15186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753777024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788263493.885747:0:15186:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788263493.885797:0:15186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753777024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263493.885804:0:15186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788263493.885826:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753777280:0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.885851:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263493.885871:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788263493.885876:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753777152:0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.885904:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263493.885924:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753777664:0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.885947:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263493.885969:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753777408:0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.885987:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263493.886019:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753777024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263493.886033:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788263493.886052:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753777536:0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.886076:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788263493.886096:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788263493.886109:0:16933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753777280 00000100:00100000:1.0:1788263493.886113:0:16933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753777280 00000100:00100000:1.0:1788263493.886144:0:16933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788263493.886151:0:16933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753777280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.886185:0:16933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753777280:12345-0@lo:400:kworker.0 Request processed in 35us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263493.886191:0:16933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788263493.886207:0:14491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753777152 00000100:00100000:1.0:1788263493.886211:0:14491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753777152 00000100:00100000:1.0:1788263493.886371:0:14491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788263493.886378:0:14491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753777152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.886407:0:14491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753777152:12345-0@lo:400:kworker.0 Request processed in 30us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263493.886413:0:14491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788263493.886435:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753777664 00000100:00100000:1.0:1788263493.886439:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753777664 00000100:00100000:1.0:1788263493.886456:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753777408 00000100:00100000:1.0:1788263493.886459:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753777408 00000100:00100000:1.0:1788263493.886468:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753777536 00000100:00100000:1.0:1788263493.886470:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753777536 00000100:00100000:1.0:1788263493.886482:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788263493.886488:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753777664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.886515:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753777664:12345-0@lo:400:kworker.0 Request processed in 27us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263493.886522:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788263493.886539:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788263493.886545:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753777408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.886574:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753777408:12345-0@lo:400:kworker.0 Request processed in 29us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263493.886580:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788263493.886590:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788263493.886596:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753777536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.886621:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753777536:12345-0@lo:400:kworker.0 Request processed in 25us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263493.886627:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788263493.886644:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788263493.886646:0:14493:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263493.886664:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753777152:0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.886674:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753777664:0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.886683:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753777280:0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.886719:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753777536:0@lo:400:kworker.0 00000100:00100000:1.0:1788263493.886729:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753777408:0@lo:400:kworker.0 00000001:00100000:2.0:1788263493.937726:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03b4c7a6-bb3d-4ac1-a18b-dbce72656187 00000001:00080000:2.0:1788263493.937741:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1788263493.937746:0:5874:0:(genops.c:885:class_export_put()) final put ffff9942435e9800/03b4c7a6-bb3d-4ac1-a18b-dbce72656187 00000001:00100000:2.0:1788263493.937777:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aaa94f48-2848-4430-a76d-a41ea14a2177 00000001:00080000:2.0:1788263493.937783:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:2.0:1788263493.937792:0:5874:0:(genops.c:885:class_export_put()) final put ffff994243364000/aaa94f48-2848-4430-a76d-a41ea14a2177 00000020:00000080:0.0:1788263493.937885:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942435e9800/03b4c7a6-bb3d-4ac1-a18b-dbce72656187 for lustre-MDT0000 00000020:00000080:0.0:1788263493.937953:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994243364000/aaa94f48-2848-4430-a76d-a41ea14a2177 for lustre-MDT0000 00000020:00000080:0.0:1788263493.937985:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942435eb000 for lustre-MDT0000 00000020:00000080:0.0:1788263493.937990:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994241ada000 for lustre-MDT0000 00010000:00010000:1.0:1788263493.949142:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788263494.462990:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aaa94f48-2848-4430-a76d-a41ea14a2177 00000020:00000080:2.0:1788263494.463012:0:6729:0:(genops.c:885:class_export_put()) final put ffff9942435ee000/aaa94f48-2848-4430-a76d-a41ea14a2177 00000020:00000080:2.0:1788263494.463045:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942435ee000/aaa94f48-2848-4430-a76d-a41ea14a2177 for lustre-OST0000 00000020:00000080:2.0:1788263494.463107:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942435e8000 for lustre-OST0000 00000020:01000004:3.0:1788263494.488496:0:17641:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788263494.510395:0:17641:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788263494.510448:0:17641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.510464:0:17641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.510472:0:17641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.510481:0:17641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.510519:0:17641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788263494.510525:0:17641:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788263494.510549:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788263494.510554:0:17641:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788263494.510560:0:17641:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788263494.510584:0:17641:0:(import.c:65:import_set_state_nolock()) ffff994381495000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788263494.510641:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263494.510654:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263494.510669:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6c00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263494.510673:0:14486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263494.510681:0:14486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263494.510689:0:14486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263494.510695:0:14486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788263494.510697:0:14486:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788263494.510700:0:14486:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788263494.510725:0:14486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263494.510732:0:14486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263494.510767:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263494.510774:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943810d6c00/0x1a657bc513956bfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956c01 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263494.510785:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263494.510787:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263494.510789:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263494.510886:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753777920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788263494.510953:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263494.511055:0:14484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753777920 00000100:00100000:0.0:1788263494.511062:0:14484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753777920 00000100:00100000:0.0:1788263494.511119:0:14484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263494.511129:0:14484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3323:x1875129753777920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263494.511149:0:14484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263494.511164:0:14484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99437f6b0a00/0x1a657bc513956c01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956bfa expref: 19 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263494.511175:0:14484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263494.511247:0:14484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:91f17ece-9654-41b2-8823-2d6af9d5176a+18:3323:x1875129753777920:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263494.511256:0:14484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788263494.511293:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753777920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263494.511409:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753777792:0@lo:39:umount.0 00000100:00100000:2.0:1788263494.511442:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263494.511529:0:14499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753777792 00000100:00100000:0.0:1788263494.511534:0:14499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753777792 00000100:00100000:0.0:1788263494.511569:0:14499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788263494.511576:0:14499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875129753777792:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788263494.511598:0:14499:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956c2b 00000100:00080000:0.0:1788263494.511605:0:14499:0:(import.c:65:import_set_state_nolock()) ffff994347321000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788263494.511674:0:14499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3319:x1875129753777792:12345-0@lo:39:umount.0 Request processed in 98us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263494.511680:0:14499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:0.0:1788263494.511686:0:14499:0:(genops.c:885:class_export_put()) final put ffff994347322800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788263494.511813:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788263494.511834:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994381495000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788263494.511849:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753777792:0@lo:39:umount.0 00000100:00080000:3.0:1788263494.511896:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788263494.511899:0:17641:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788263494.511904:0:17641:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788263494.512809:0:17641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512822:0:17641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512829:0:17641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512836:0:17641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512854:0:17641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263494.512859:0:17641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512876:0:17641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512883:0:17641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512890:0:17641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512904:0:17641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788263494.512913:0:17641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512919:0:17641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512924:0:17641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512929:0:17641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512936:0:17641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788263494.512941:0:17641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512947:0:17641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512961:0:17641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512967:0:17641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263494.512975:0:17641:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788263494.512978:0:17641:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788263494.512998:0:17641:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788263494.513002:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788263494.513005:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788263494.513010:0:17641:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1788263494.513015:0:17641:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9943803e8800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788263494.513020:0:17641:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9943803c2800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788263494.513025:0:17641:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9943809499b8) has exports, disconnecting them 00000020:00080000:3.0:1788263494.513029:0:17641:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9943803e8800), last request at 1788263493 00000020:00000080:3.0:1788263494.513035:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956de4 00000100:00080000:3.0:1788263494.513053:0:17641:0:(import.c:65:import_set_state_nolock()) ffff9943803ef800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788263494.513092:0:17641:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9943803e8800): rc 0 00000020:00000080:3.0:1788263494.513094:0:17641:0:(genops.c:885:class_export_put()) final put ffff9943803e8800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788263494.513100:0:17641:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9943803c2800), last request at 1788263493 00000020:00000080:3.0:1788263494.513103:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956cb0 00000100:00080000:3.0:1788263494.513108:0:17641:0:(import.c:65:import_set_state_nolock()) ffff9943803c7800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788263494.513113:0:17641:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9943803c2800): rc 0 00000020:00000080:3.0:1788263494.513115:0:17641:0:(genops.c:885:class_export_put()) final put ffff9943803c2800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788263494.513121:0:17641:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb13204497ae0 00000100:00080000:3.0:1788263494.513138:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788263494.513145:0:17641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:3.0:1788263494.513157:0:17641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788263494.513261:0:17641:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788263494.513279:0:17641:0:(import.c:65:import_set_state_nolock()) ffff99434646c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788263494.513293:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788263494.513294:0:17641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788263494.513301:0:17641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788263494.513356:0:17641:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788263494.513364:0:17641:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788263494.513391:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9943809499b8) has no exports 00010000:00010000:2.0:1788263494.513613:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788263494.513619:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513627:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b0200 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263494.513631:0:14485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513640:0:14485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263494.513699:0:14485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263494.513705:0:14485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788263494.513707:0:14485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788263494.513709:0:14485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788263494.513733:0:14485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513738:0:14485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263494.513769:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513786:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99437f6b0200/0x1a657bc513956b60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956b67 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513797:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788263494.513800:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513806:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d000 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263494.513810:0:14485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513816:0:14485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263494.513822:0:14485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263494.513826:0:14485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788263494.513828:0:14485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788263494.513830:0:14485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788263494.513844:0:14485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513849:0:14485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263494.513855:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513862:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99438216d000/0x1a657bc513956df2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956df9 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513886:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788263494.513889:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513895:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158e00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263494.513899:0:14485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513906:0:14485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263494.513911:0:14485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263494.513916:0:14485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788263494.513918:0:14485:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788263494.513919:0:14485:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788263494.513934:0:14485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513938:0:14485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263494.513953:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513959:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343158e00/0x1a657bc513956f6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956f73 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513968:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263494.513971:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513982:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d7600 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263494.513985:0:14485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.513992:0:14485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263494.513998:0:14485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263494.514003:0:14485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788263494.514006:0:14485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788263494.514007:0:14485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788263494.514020:0:14485:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.514025:0:14485:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263494.514030:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.514036:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943810d7600/0x1a657bc513956b52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956b59 expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.514048:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263494.514049:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263494.514051:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263494.514066:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753778432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263494.514122:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263494.514162:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788263494.514177:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753778304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263494.514204:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788263494.514342:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263494.514566:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753778688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263494.514592:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263494.514617:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263494.514623:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753778560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263494.514641:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263494.514673:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753778432 00000100:00100000:2.0:1788263494.514678:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753778432 00000100:00100000:2.0:1788263494.514712:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753778304 00000100:00100000:2.0:1788263494.514714:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753778304 00000100:00100000:2.0:1788263494.514725:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753778688 00000100:00100000:2.0:1788263494.514727:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753778688 00000100:00100000:2.0:1788263494.514737:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753778560 00000100:00100000:2.0:1788263494.514739:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753778560 00000100:00100000:2.0:1788263494.514763:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263494.514772:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+21:3321:x1875129753778432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263494.514784:0:14482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263494.514797:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99437f6b0600/0x1a657bc513956df9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956df2 expref: 21 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.514811:0:14482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263494.514844:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+20:3321:x1875129753778432:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263494.514850:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263494.514865:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263494.514871:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+19:3321:x1875129753778304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263494.514878:0:14482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263494.514892:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216de00/0x1a657bc513956b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956b60 expref: 19 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.514901:0:14482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263494.514922:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375ec0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+18:3321:x1875129753778304:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263494.514928:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788263494.514963:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788263494.514969:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+17:3323:x1875129753778688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263494.514976:0:14482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263494.514984:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216c000/0x1a657bc513956b59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956b52 expref: 17 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.514994:0:14482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263494.515018:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+16:3323:x1875129753778688:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263494.515025:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788263494.515037:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263494.515044:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+15:3323:x1875129753778560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263494.515050:0:14482:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263494.515058:0:14482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d6200/0x1a657bc513956f73 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956f6c expref: 15 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.515066:0:14482:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263494.515087:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:91f17ece-9654-41b2-8823-2d6af9d5176a+14:3323:x1875129753778560:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263494.515092:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263494.515132:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753778560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263494.515148:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:91f17ece-9654-41b2-8823-2d6af9d5176a:3323:1875129753778688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263494.515170:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753778048:0@lo:9:umount.0 00000100:00100000:2.0:1788263494.515199:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263494.515240:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753778176:0@lo:9:umount.0 00000100:00100000:2.0:1788263494.515264:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263494.515297:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753778048 00000100:00100000:2.0:1788263494.515301:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753778048 00000100:00100000:2.0:1788263494.515323:0:15183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753778176 00000100:00100000:2.0:1788263494.515326:0:15183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753778176 00000100:00100000:2.0:1788263494.515341:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263494.515348:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875129753778048:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788263494.515366:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956ccc 00000100:00080000:2.0:1788263494.515377:0:15183:0:(import.c:65:import_set_state_nolock()) ffff9943803eb800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788263494.515404:0:15183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:2.0:1788263494.515710:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3319:x1875129753778048:12345-0@lo:9:umount.0 Request processed in 361us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263494.515718:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788263494.515731:0:15183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788263494.515737:0:15183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875129753778176:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788263494.515762:0:15183:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956e00 00000100:00080000:2.0:1788263494.515769:0:15183:0:(import.c:65:import_set_state_nolock()) ffff994243364800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788263494.515789:0:15183:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788263494.515964:0:15183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3319:x1875129753778176:12345-0@lo:9:umount.0 Request processed in 226us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263494.515970:0:15183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788263494.515986:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263494.516013:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753778304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263494.516021:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:91f17ece-9654-41b2-8823-2d6af9d5176a:3321:1875129753778432:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788263494.516049:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99434646c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788263494.516061:0:3319:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788263494.516063:0:3319:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788263494.516065:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753778048:0@lo:9:umount.0 00000100:00080000:2.0:1788263494.516076:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437fb70800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788263494.516083:0:3319:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788263494.516085:0:3319:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788263494.516087:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753778176:0@lo:9:umount.0 00010000:00010000:2.0:1788263494.516107:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788263494.516363:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994347322800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788263494.516417:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803e8800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788263494.516440:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803c2800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788263494.516460:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994347321000 for lustre-MDT0000 00000020:00000080:1.0:1788263494.516464:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9943803ef800 for lustre-MDT0000 00000020:00000080:1.0:1788263494.516467:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9943803c7800 for lustre-MDT0000 00000020:00080000:3.0:1788263494.526673:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9943809499b8) has no exports 00000020:00000080:3.0:1788263494.587105:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956bad 00000020:00000080:3.0:1788263494.587122:0:17641:0:(genops.c:885:class_export_put()) final put ffff994349ba5800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788263494.587144:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788263494.587285:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994349ba5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788263494.587314:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788263494.587324:0:17641:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788263494.587328:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff994380948000) has no exports 00000020:00000080:2.0:1788263494.590433:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956ba6 00000020:00000080:2.0:1788263494.590448:0:17641:0:(genops.c:885:class_export_put()) final put ffff994342bf8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788263494.590521:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263494.590532:0:17641:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788263494.590535:0:17641:0:(genops.c:885:class_export_put()) final put ffff99437f529000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788263494.590537:0:17641:0:(genops.c:844:class_export_destroy()) destroying export ffff99437f529000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788263494.590544:0:17641:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788263494.590840:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994342bf8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788263494.590895:0:17641:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994349cde300 - data ffff994366f48e58/ffff994243813400 00000020:01000000:2.0:1788263494.591037:0:17641:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994349cdea80 - data ffff99437ffc46c0/ffff99437bad7c00 00000001:00000004:2.0:1788263494.607368:0:17641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:3.0:1788263494.727665:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788263494.727674:0:17641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:3.0:1788263494.727705:0:17641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788263494.727708:0:17641:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788263494.728315:0:14519:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788263494.728322:0:14519:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:0.0:1788263494.728332:0:14519:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788263494.729374:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788263494.729379:0:17641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788263494.729394:0:17641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788263494.729396:0:17641:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788263494.730106:0:14521:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788263494.730110:0:14521:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:0.0:1788263494.730122:0:14521:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788263494.823566:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956b75 00000020:00000080:1.0:1788263494.823578:0:17641:0:(genops.c:885:class_export_put()) final put ffff99437fb72000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788263494.824380:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956b8a 00000020:00000080:1.0:1788263494.824390:0:17641:0:(genops.c:885:class_export_put()) final put ffff99437f529800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788263494.824395:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788263494.824399:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263494.824407:0:17641:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788263494.824411:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff994349ce4d28) has no exports 00000004:01000000:1.0:1788263494.824555:0:17641:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788263494.824562:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956bd7 00000020:00000080:1.0:1788263494.824567:0:17641:0:(genops.c:885:class_export_put()) final put ffff99438144d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788263494.824570:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788263494.824573:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263494.824577:0:17641:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788263494.824579:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff994346b33370) has no exports 00000020:00000080:1.0:1788263494.824584:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956bd0 00000020:00000080:1.0:1788263494.824587:0:17641:0:(genops.c:885:class_export_put()) final put ffff99437fb75800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788263494.824948:0:17641:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788263494.824953:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788263494.824957:0:17641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788263494.824963:0:17641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788263494.824966:0:17641:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788263494.824998:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263494.825005:0:17641:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788263494.825010:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956bc2 00000020:00000080:1.0:1788263494.825015:0:17641:0:(genops.c:885:class_export_put()) final put ffff994372117800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788263494.825019:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788263494.825023:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263494.825025:0:17641:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788263494.825028:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff99437f9cb370) has no exports 00000020:00000080:1.0:1788263494.825031:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956bbb 00000020:00000080:1.0:1788263494.825034:0:17641:0:(genops.c:885:class_export_put()) final put ffff99434646c000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788263494.825375:0:17641:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788263494.825379:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788263494.825381:0:17641:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:1.0:1788263494.825384:0:17641:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788263494.825386:0:17641:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788263494.825409:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263494.825414:0:17641:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788263494.825436:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263494.825438:0:17641:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788263494.825463:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956b91 00000020:00000080:1.0:1788263494.825467:0:17641:0:(genops.c:885:class_export_put()) final put ffff99437f528800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788263494.825470:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788263494.825474:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263494.825476:0:17641:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788263494.825479:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff99438094b370) has no exports 00000020:00000080:1.0:1788263494.825495:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263494.825498:0:17641:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788263494.825501:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956b98 00000020:00000080:1.0:1788263494.825504:0:17641:0:(genops.c:885:class_export_put()) final put ffff99437f52b000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788263494.825511:0:17641:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99434660c800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788263494.825514:0:17641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99434660c800 3 00000020:01000004:1.0:1788263494.825518:0:17641:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99434660c800 from lustre-MDT0000 00000020:00000080:1.0:1788263494.825536:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263494.825539:0:17641:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788263494.825541:0:17641:0:(genops.c:885:class_export_put()) final put ffff99437fb74800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788263494.825543:0:17641:0:(genops.c:844:class_export_destroy()) destroying export ffff99437fb74800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788263494.825551:0:17641:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788263494.825615:0:17641:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788263494.825619:0:17641:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788263494.825622:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788263494.825624:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263494.825626:0:17641:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788263494.825632:0:17641:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9942421af000 91f17ece-9654-41b2-8823-2d6af9d5176a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788263494.825644:0:17641:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff994349ce19b8) has exports, disconnecting them 00000020:00080000:1.0:1788263494.825648:0:17641:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9942421af000), last request at 1788263408 00000020:00000080:1.0:1788263494.825663:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956b3d 00000020:00010000:1.0:1788263494.825667:0:17641:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9942421af000: total 8 00000100:00080000:1.0:1788263494.825670:0:17641:0:(import.c:65:import_set_state_nolock()) ffff9942421a8000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788263494.825694:0:17641:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9942421af000): rc 0 00000020:00080000:1.0:1788263494.825698:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff994349ce19b8) has no exports 00000100:00100000:1.0:1788263494.825759:0:14491:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff994380c9fa00:14491] 1 exiting: rc = 0 00000100:00100000:1.0:1788263494.825834:0:14492:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9943438bea00:14492] 2 exiting: rc = 0 00000020:00000080:3.0:1788263494.826026:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437fb72000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788263494.826040:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437f529800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788263494.826044:0:8:0:(genops.c:885:class_export_put()) final put ffff99437fa2b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788263494.826046:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437fa2b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788263494.826052:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788263494.826144:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99438144d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788263494.826150:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437fb75800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788263494.826161:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99437fb70800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788263494.826166:0:8:0:(genops.c:885:class_export_put()) final put ffff994372114000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788263494.826168:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994372114000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788263494.826172:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788263494.826201:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994372117800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788263494.826207:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99434646c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788263494.826210:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99434646c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788263494.826213:0:8:0:(genops.c:885:class_export_put()) final put ffff99437fb71800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788263494.826241:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437fb71800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788263494.826245:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788263494.826292:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437f528800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788263494.826296:0:8:0:(genops.c:885:class_export_put()) final put ffff99437fb73000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788263494.826297:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437fb73000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788263494.826301:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788263494.826377:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437f52b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788263494.827365:0:14486:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9942421af000: total 0 00010000:00010000:2.0:1788263494.827403:0:14486:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9942421af000, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1788263494.827435:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994380659000/0x1a657bc513956da5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956d9e expref: 9 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.827461:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d7200/0x1a657bc513956f65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956f5e expref: 8 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.827473:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99437f6b1e00/0x1a657bc513956c63 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956c5c expref: 7 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.827487:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99437f6b1400/0x1a657bc513956dcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956dc8 expref: 6 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.827495:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994380659e00/0x1a657bc513956c71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956c6a expref: 5 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.827505:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9943810d7a00/0x1a657bc513956f57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956f50 expref: 4 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.827514:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99437f6b1a00/0x1a657bc513956b4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956b44 expref: 3 pid: 14490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.827523:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994380658400/0x1a657bc513956c9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x1a657bc513956c94 expref: 2 pid: 14491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263494.827532:0:14486:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9942421af000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788263494.827544:0:14486:0:(genops.c:885:class_export_put()) final put ffff9942421af000/91f17ece-9654-41b2-8823-2d6af9d5176a 00010000:00010000:2.0:1788263494.827563:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263494.827566:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263494.827568:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263494.827603:0:14490:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9943503df400:14490] 0 exiting: rc = 1 00000020:00000080:3.0:1788263494.827795:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942421af000/91f17ece-9654-41b2-8823-2d6af9d5176a for MGS 00000020:00000080:3.0:1788263494.827829:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942421a8000 for MGS 00000100:00100000:1.0:1788263494.827900:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827909:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827915:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827922:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827928:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827934:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827940:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827948:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827954:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827961:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827966:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827972:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827978:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827984:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827990:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.827997:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828002:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828008:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828013:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828018:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828023:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828028:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828034:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828039:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828055:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828059:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828064:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828069:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828075:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828080:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828085:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828090:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828095:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828100:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828105:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828111:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828116:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828122:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828127:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828133:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828140:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828145:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828150:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828156:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828161:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828167:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828173:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828178:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828183:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828188:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828193:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828199:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828204:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828210:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828215:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828253:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828259:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828264:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828269:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828281:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828286:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828291:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828296:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263494.828303:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788263494.828816:0:17641:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788263494.828820:0:17641:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788263494.830474:0:17641:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994342a72540 - data ffff99436d85aca8/ffff994242e1d800 00000020:01000000:1.0:1788263494.830603:0:17641:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994241ab64e0 - data ffff99437903b288/ffff99437fb41000 00000020:00000080:1.0:1788263494.831171:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956b21 00000020:00000080:1.0:1788263494.831179:0:17641:0:(genops.c:885:class_export_put()) final put ffff99434660d800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788263494.831198:0:17641:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99434660c800 from MGS, refs=2 00000020:01000004:1.0:1788263494.831202:0:17641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99434660c800 2 00000020:01000004:1.0:1788263494.831205:0:17641:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99434660c800 from MGS 00000020:00000080:1.0:1788263494.831253:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788263494.831260:0:17641:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788263494.831263:0:17641:0:(genops.c:885:class_export_put()) final put ffff99434660e800/MGS 00000020:00000080:1.0:1788263494.831266:0:17641:0:(genops.c:844:class_export_destroy()) destroying export ffff99434660e800/MGS for MGS 00000020:01000000:1.0:1788263494.831273:0:17641:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788263494.831323:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788263494.831327:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788263494.831333:0:17641:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788263494.831339:0:17641:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9943744bf800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788263494.831345:0:17641:0:(genops.c:1553:class_disconnect_exports()) OBD device 10 (ffff994346b30000) has exports, disconnecting them 00000020:00080000:1.0:1788263494.831349:0:17641:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9943744bf800), last request at 1788263409 00000020:00000080:1.0:1788263494.831353:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956c0f 00000020:00080000:1.0:1788263494.831362:0:17641:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9943744bf800): rc 0 00000020:00000080:1.0:1788263494.831365:0:17641:0:(genops.c:885:class_export_put()) final put ffff9943744bf800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788263494.831816:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99434660d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788263494.831825:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9943744bf800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788263494.835282:0:17641:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788263494.835292:0:17641:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263494.835307:0:17641:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788263494.835315:0:17641:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788263494.835495:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263494.835503:0:17641:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788263494.835511:0:17641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99434660c800 1 00000020:00000080:0.0:1788263494.835529:0:17641:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956b13 00000020:00000080:0.0:1788263494.835538:0:17641:0:(genops.c:885:class_export_put()) final put ffff99434660c000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788263494.835544:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788263494.835548:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263494.835552:0:17641:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788263494.835556:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff994349ce3370) has no exports 00000020:00000080:3.0:1788263494.835789:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994381495000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788263494.835797:0:37:0:(genops.c:885:class_export_put()) final put ffff994381494800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788263494.835800:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff994381494800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788263494.835807:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788263494.835858:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99434660c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788263494.848662:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788263494.848675:0:17641:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788263494.848689:0:17641:0:(genops.c:885:class_export_put()) final put ffff994346609800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788263494.848705:0:17641:0:(genops.c:844:class_export_destroy()) destroying export ffff994346609800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788263494.848715:0:17641:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788263494.848856:0:17641:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff994346608000 00000020:01000000:3.0:1788263494.848878:0:17641:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788263494.848882:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788263494.848886:0:17641:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788263494.848890:0:17641:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff994349ce0000) has no exports 00000100:00100000:3.0:1788263494.848958:0:14498:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff99435bf29200:14498] 1 exiting: rc = 0 00000100:00100000:3.0:1788263494.851278:0:14499:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9943499d4800:14499] 2 exiting: rc = 0 00000100:00100000:1.0:1788263494.851477:0:14497:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff99435bf28600:14497] 0 exiting: rc = 1 00000100:00100000:3.0:1788263494.851882:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851890:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851895:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851900:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851907:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851912:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851919:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851924:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851931:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851936:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851942:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851947:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851952:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851956:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851961:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851966:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851972:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851976:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851982:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851987:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851993:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.851999:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852004:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852010:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852015:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852034:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852040:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852045:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852051:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852056:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852061:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852066:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852071:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852076:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852082:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852087:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852092:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852097:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852104:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852110:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852115:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852120:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852126:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852132:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852137:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852143:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852147:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852153:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852158:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852162:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852168:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852174:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852180:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852186:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852191:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852196:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852201:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852207:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852212:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852240:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852258:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852266:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852271:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.852277:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.861180:0:14500:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9943499d5400:14500] 0 exiting: rc = 1 00000100:00100000:0.0:1788263494.861338:0:14501:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff994241ae0c00:14501] 1 exiting: rc = 0 00000100:00100000:3.0:1788263494.861738:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861757:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861765:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861771:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861776:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861781:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861786:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861791:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861796:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861802:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861807:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861813:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861818:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861823:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861828:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861833:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861838:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861843:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861849:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861855:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861860:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861864:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861869:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861874:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861878:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861882:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861887:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861892:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861896:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861901:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861907:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861926:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861931:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861936:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861942:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861947:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861951:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861957:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861962:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861966:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861971:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861976:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861981:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861986:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861991:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.861996:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862002:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862007:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862011:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862016:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862021:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862026:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862031:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862037:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862042:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862047:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862052:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862056:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862061:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862066:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862071:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862076:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862081:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.862086:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.862794:0:14503:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff994347c5a200:14503] 1 exiting: rc = 0 00000100:00100000:2.0:1788263494.870053:0:16731:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff994241811200:16731] 2 exiting: rc = 0 00000100:00100000:2.0:1788263494.870174:0:14502:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff994347c5b200:14502] 0 exiting: rc = 1 00000100:00100000:3.0:1788263494.870543:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870553:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870565:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870571:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870577:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870583:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870588:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870595:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870603:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870610:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870615:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870624:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870630:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870662:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870668:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870673:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870688:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870695:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870700:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870705:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870711:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870716:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870723:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870730:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870737:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870767:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870776:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870781:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870787:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870794:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870799:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870805:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870810:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870818:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870825:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870831:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870836:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870865:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870872:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870878:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870884:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870890:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870897:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870903:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870910:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870916:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870922:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870927:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870932:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870950:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870957:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870962:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870967:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870973:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870978:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870983:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870989:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.870995:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.871001:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.871006:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.871011:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.871018:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.871022:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.871036:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263494.899067:0:14504:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff994347c5ae00:14504] 0 exiting: rc = 1 00000100:00100000:0.0:1788263494.902526:0:14505:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99437f758c00:14505] 1 exiting: rc = 0 00000100:00100000:3.0:1788263494.913303:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913312:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913318:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913322:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913327:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913332:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913337:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913342:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913359:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913364:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913368:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913373:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913383:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913389:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913394:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913399:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913404:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913409:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913414:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913418:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913423:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913428:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913432:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913438:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913442:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913448:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913453:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913458:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913463:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913469:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913474:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913479:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913484:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913489:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913494:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913500:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913506:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913510:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913516:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913521:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.913526:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914121:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914127:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914141:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914146:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914151:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914156:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914162:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914167:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914172:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914177:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914182:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914187:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914193:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914199:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914204:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914209:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914214:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914252:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914258:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914263:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914268:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914274:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263494.914279:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.915495:0:14507:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99434f231400:14507] 1 exiting: rc = 0 00000100:00100000:3.0:1788263494.919355:0:14506:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff994346652400:14506] 0 exiting: rc = 1 00000100:00100000:0.0:1788263494.919632:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919640:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919645:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919650:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919655:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919660:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919664:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919670:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919675:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919680:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919696:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919703:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919707:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919712:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919717:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919723:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919728:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919761:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919766:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919772:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919776:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919781:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919787:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919792:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919797:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919802:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919807:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919812:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919817:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919823:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919828:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919833:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919839:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919844:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919848:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919852:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919857:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919862:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919867:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919873:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919879:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919884:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919890:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919895:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919900:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919905:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919910:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919915:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919920:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919926:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919930:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919935:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919948:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919953:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919957:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919963:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919968:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919973:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919979:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919984:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919989:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919994:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.919999:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.920004:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.920395:0:14508:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9943499d6600:14508] 0 exiting: rc = 1 00000100:00100000:3.0:1788263494.920831:0:14509:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff99434f231600:14509] 1 exiting: rc = 0 00000100:00100000:0.0:1788263494.920959:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.920966:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.920972:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.920977:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.920982:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.920988:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.920993:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.920998:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921003:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921007:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921012:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921017:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921021:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921027:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921032:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921038:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921043:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921049:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921055:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921060:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921065:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921070:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921086:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921092:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921097:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921103:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921108:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921113:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921117:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921122:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921128:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921133:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921138:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921143:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921149:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921155:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921160:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921165:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921170:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921175:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921180:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921185:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921189:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921194:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921199:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921204:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921208:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921213:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921244:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921249:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921254:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921260:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921265:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921270:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921275:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921280:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921285:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921298:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921303:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921308:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921313:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921318:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921323:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921327:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.921808:0:14511:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff994375e8ca00:14511] 1 exiting: rc = 0 00000100:00100000:3.0:1788263494.921891:0:14510:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff994375e8dc00:14510] 0 exiting: rc = 1 00000100:00100000:0.0:1788263494.922252:0:14512:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff99434f2ad400:14512] 2 exiting: rc = 0 00000100:00100000:0.0:1788263494.922304:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922311:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922316:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922329:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922335:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922342:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922348:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922353:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922359:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922364:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922370:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922375:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922400:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922407:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922413:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922418:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922424:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922429:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922435:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922441:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922446:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922451:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922457:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922462:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922467:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922473:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922486:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922492:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922498:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922504:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922509:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922578:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922587:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922593:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922598:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922603:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922622:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922630:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922636:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922641:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922647:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922652:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922658:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922663:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922668:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922673:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922746:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922753:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922758:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922764:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922770:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922775:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922781:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922787:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922793:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922798:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922804:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922809:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922814:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922819:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922824:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922836:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922841:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788263494.922847:0:17641:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788263494.931283:0:17641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263494.931296:0:17641:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788263494.931303:0:17641:0:(genops.c:885:class_export_put()) final put ffff99437fa2a000/MDS_uuid 00000020:00000080:0.0:1788263494.931307:0:17641:0:(genops.c:844:class_export_destroy()) destroying export ffff99437fa2a000/MDS_uuid for MDS 00000020:01000000:0.0:1788263494.931318:0:17641:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788263494.931484:0:17641:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788263495.064994:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263496.126760:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263497.147339:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788263497.850559:0:17790:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788263497.862516:0:17790:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788263497.862568:0:17790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263497.862583:0:17790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263497.862719:0:17790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263497.862745:0:17790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263497.862764:0:17790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788263497.862771:0:17790:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788263497.862795:0:17790:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788263497.862799:0:17790:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788263497.862804:0:17790:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788263497.862828:0:17790:0:(import.c:65:import_set_state_nolock()) ffff9943803e4000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788263497.862888:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1875129753778816:0@lo:39:umount.0 00000400:00000100:0.0:1788263497.862935:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753778816 offset 0 length 224: 4 00010000:00010000:2.0:1788263497.863067:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263497.863075:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263497.863083:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b0c00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263497.863087:0:14486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263497.863096:0:14486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263497.863103:0:14486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263497.863109:0:14486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788263497.863112:0:14486:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788263497.863114:0:14486:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788263497.863138:0:14486:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263497.863144:0:14486:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263497.863169:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263497.863177:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99437f6b0c00/0x1a657bc513956c94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x1a657bc513956c9b expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263497.863198:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263497.863200:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263497.863201:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263497.863349:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753778944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788263497.863388:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263497.863441:0:14482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753778944 00000100:00100000:1.0:1788263497.863448:0:14482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753778944 00000100:00100000:1.0:1788263497.863480:0:14482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263497.863487:0:14482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3320:x1875129753778944:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788263497.863493:0:14482:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788263497 with bad export cookie 1902062504001235773 00000100:00100000:1.0:1788263497.868979:0:14482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3320:x1875129753778944:12345-0@lo:103:ldlm_bl.0 Request processed in 5481us (5581us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788263497.868994:0:14482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788263497.869085:0:3320:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788263497.869090:0:3320:0:(import.c:65:import_set_state_nolock()) ffff9942421ac800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788263497.869094:0:3320:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788263497.876807:0:3320:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.129@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788263497.876813:0:3320:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788263497.876823:0:3320:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994379f26680 x1875129753778944/t0(0) o103->MGC192.168.201.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788263513 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788263497.876836:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788263497.876839:0:3320:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788263497.876840:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788263497.876844:0:3320:0:(import.c:65:import_set_state_nolock()) ffff9942421ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263497.876849:0:3320:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1788263497.876856:0:3320:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9942421ac800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788263497.876889:0:3320:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994379f24a80 x1875129753779072/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263497.876924:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:91f17ece-9654-41b2-8823-2d6af9d5176a:3320:1875129753778944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263497.877437:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91f17ece-9654-41b2-8823-2d6af9d5176a:3319:1875129753779072:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1788263497.877497:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875129753779072 offset 0 length 520: 4 00010000:00010000:2.0:1788263498.171613:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788263499.003505:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91f17ece-9654-41b2-8823-2d6af9d5176a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788263499.003516:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 91f17ece-9654-41b2-8823-2d6af9d5176a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788263499.003710:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753779200:0@lo:400:kworker.0 00000400:00000100:3.0:1788263499.003765:0:3321:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753779200 offset 0 length 224: 4 00000001:00100000:2.0:1788263499.056552:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788263499.056559:0:7662:0:(genops.c:885:class_export_put()) final put ffff994243365800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788263499.056789:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994243365800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788263499.056839:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff994243364800 for lustre-OST0001 00010000:00010000:2.0:1788263499.195467:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788263499.565577:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788263499.565586:0:6729:0:(genops.c:885:class_export_put()) final put ffff9943803eb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788263499.565670:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803eb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788263499.565722:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9943803eb800 for lustre-OST0000 00010000:00010000:2.0:1788263500.220288:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263501.243969:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263502.268197:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788263503.038169:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91f17ece-9654-41b2-8823-2d6af9d5176a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788263503.038179:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 91f17ece-9654-41b2-8823-2d6af9d5176a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788263503.038637:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753779328:0@lo:400:kworker.0 00000400:00000100:0.0:1788263503.038686:0:3322:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753779328 offset 0 length 224: 4 00010000:00010000:2.0:1788263503.292212:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263504.316631:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263505.339897:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263506.364094:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263507.197752:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263497/real 1788263497] req@ffff994379f24a80 x1875129753779072/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788263507 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263507.197784:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994379f24a80 x1875129753779072/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788263507 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263507.197795:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263497/real 1788263497] req@ffff9943755bf800 x1875129753778816/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263507 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263507.197807:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9943755bf800 x1875129753778816/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263507 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788263507.197825:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9942421ac800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263507.197854:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788263507.197858:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91f17ece-9654-41b2-8823-2d6af9d5176a:3319:1875129753779072:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788263507.197884:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9943803e4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788263507.197902:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1875129753778816:0@lo:39:umount.0 00000100:00080000:3.0:1788263507.198003:0:17790:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788263507.198007:0:17790:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788263507.198012:0:17790:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788263507.198852:0:17790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263507.198867:0:17790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263507.198874:0:17790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263507.198881:0:17790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263507.198906:0:17790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263507.198925:0:17790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263507.198932:0:17790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263507.198938:0:17790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263507.198944:0:17790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263507.198967:0:17790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788263507.198971:0:17790:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788263507.199001:0:17790:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788263507.199005:0:17790:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788263507.199010:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788263507.199016:0:17790:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788263507.199020:0:17790:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff99438094cd28) has no exports 00000020:00080000:3.0:1788263507.199045:0:17790:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff99438094cd28) has no exports 00010000:00010000:2.0:1788263507.200719:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788263507.200731:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263507.200742:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216d800 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263507.200746:0:14486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263507.200756:0:14486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263507.200764:0:14486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263507.200769:0:14486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788263507.200772:0:14486:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788263507.200775:0:14486:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788263507.200792:0:14486:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942421ac800 00010000:00010000:2.0:1788263507.200795:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1788263507.200807:0:17790:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99435bc46ea0 - data ffff99437ff6f870/ffff9942439e3400 00010000:00010000:2.0:1788263507.200815:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99438216d800/0x1a657bc513956c6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956c71 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263507.200830:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263507.200834:0:14486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263507.200839:0:14486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9943810d6800 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263507.200843:0:14486:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263507.200850:0:14486:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263507.200856:0:14486:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263507.200860:0:14486:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788263507.200862:0:14486:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788263507.200865:0:14486:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788263507.200870:0:14486:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942421ac800 00010000:00010000:2.0:1788263507.200872:0:14486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263507.200878:0:14486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9943810d6800/0x1a657bc513956f5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956f65 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263507.200886:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263507.200888:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263507.200893:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788263507.200926:0:17790:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99435288d300 - data ffff994366d3dca8/ffff9942438cb000 00000100:00080000:1.0:1788263507.200973:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91f17ece-9654-41b2-8823-2d6af9d5176a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788263507.200978:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788263507.200982:0:8:0:(import.c:65:import_set_state_nolock()) ffff9942421ac800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263507.200989:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 524 00000100:00080000:1.0:1788263507.200993:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788263507.200998:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9942421ac800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263507.201029:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994375bfa680 x1875129753779456/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788263507.201099:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753779584:0@lo:400:kworker.0 00000400:00000100:1.0:1788263507.201148:0:3323:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753779584 offset 0 length 224: 4 00010000:00010000:0.0:1788263507.201275:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263507.201355:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91f17ece-9654-41b2-8823-2d6af9d5176a:3319:1875129753779456:0@lo:250:kworker.0 00000400:00000100:2.0:1788263507.201377:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875129753779456 offset 0 length 520: 4 00100000:10000000:3.0:1788263507.214830:0:17790:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788263507.240825:0:17790:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956c7f 00000020:00000080:0.0:1788263507.240834:0:17790:0:(genops.c:885:class_export_put()) final put ffff9943803c0000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788263507.240858:0:17790:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9943744b9800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788263507.240861:0:17790:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9943744b9800 2 00000020:01000004:0.0:1788263507.240864:0:17790:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9943744b9800 from lustre-OST0000 00000020:00000080:0.0:1788263507.240886:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788263507.240895:0:17790:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788263507.240897:0:17790:0:(genops.c:885:class_export_put()) final put ffff9943803c4800/lustre-OST0000_UUID 00000020:00000080:0.0:1788263507.240900:0:17790:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803c4800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788263507.240905:0:17790:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788263507.240941:0:17790:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788263507.240945:0:17790:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788263507.240948:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263507.240952:0:17790:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788263507.240958:0:17790:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9943803c3800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788263507.240964:0:17790:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9942421b3370) has exports, disconnecting them 00000020:00080000:0.0:1788263507.240968:0:17790:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9943803c3800), last request at 1788263424 00000020:00000080:0.0:1788263507.240972:0:17790:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956ca9 00000020:00080000:0.0:1788263507.240979:0:17790:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9943803c3800): rc 0 00000020:00000080:0.0:1788263507.240983:0:17790:0:(genops.c:885:class_export_put()) final put ffff9943803c3800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788263507.241741:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803c0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788263507.241756:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803c3800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788263507.244397:0:17790:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788263507.244406:0:17790:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788263507.244410:0:17790:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788263507.244417:0:17790:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788263507.244647:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263507.244657:0:17790:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788263507.244665:0:17790:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9943744b9800 1 00000020:00000080:2.0:1788263507.244671:0:17790:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956c4e 00000020:00000080:2.0:1788263507.244682:0:17790:0:(genops.c:885:class_export_put()) final put ffff9943744bc000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788263507.244687:0:17790:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788263507.244694:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788263507.244699:0:17790:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788263507.244703:0:17790:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff99437f9c8000) has no exports 00000020:00000080:3.0:1788263507.245265:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9943803e4000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788263507.245274:0:8:0:(genops.c:885:class_export_put()) final put ffff9943803e4800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788263507.245277:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803e4800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788263507.245286:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788263507.245343:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9943744bc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788263507.310886:0:17790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788263507.310902:0:17790:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788263507.310919:0:17790:0:(genops.c:885:class_export_put()) final put ffff9943744be000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788263507.310923:0:17790:0:(genops.c:844:class_export_destroy()) destroying export ffff9943744be000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788263507.310932:0:17790:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788263507.311058:0:17790:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9943744b8000 00000020:02000400:3.0:1788263507.311113:0:17790:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788263507.387672:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263508.411388:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263509.439384:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788263509.949156:0:17945:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788263509.972645:0:17945:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788263509.972872:0:17945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263509.972916:0:17945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263509.972924:0:17945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263509.972931:0:17945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263509.972956:0:17945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788263509.972964:0:17945:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788263509.972991:0:17945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263509.973007:0:17945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994381189500 x1875129753779200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263515 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263509.973034:0:17945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994379f26680 x1875129753779328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263519 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263509.973051:0:17945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994375bf9880 x1875129753779584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263523 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263509.973064:0:17945:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788263509.973110:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753779328:0@lo:400:kworker.0 00000100:00080000:0.0:1788263509.973145:0:17945:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788263509.973175:0:17945:0:(import.c:65:import_set_state_nolock()) ffff9943803e9000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788263509.973273:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753779584:0@lo:400:kworker.0 00000100:00100000:3.0:1788263509.973584:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753779200:0@lo:400:kworker.0 00010000:00010000:2.0:1788263509.974030:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263509.974040:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263509.974051:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99437f6b0800 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263509.974054:0:14485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263509.974064:0:14485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263509.974086:0:14485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263509.974092:0:14485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788263509.974094:0:14485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788263509.974098:0:14485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788263509.974117:0:14485:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942421ac800 00010000:00010000:2.0:1788263509.974122:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263509.974128:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99437f6b0800/0x1a657bc513956dc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956dcf expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263509.974141:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263509.974143:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263509.974145:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263509.974168:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1875129753779712:0@lo:39:umount.0 00000400:00000100:2.0:1788263509.974273:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875129753779712 offset 0 length 224: 4 00010000:00010000:0.0:1788263510.460451:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263511.483549:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788263512.315849:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91f17ece-9654-41b2-8823-2d6af9d5176a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788263512.315864:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 91f17ece-9654-41b2-8823-2d6af9d5176a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788263512.510835:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263513.534158:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263514.558379:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263515.580788:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263516.604046:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788263517.437508:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 91f17ece-9654-41b2-8823-2d6af9d5176a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788263517.437519:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 91f17ece-9654-41b2-8823-2d6af9d5176a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788263517.628269:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263518.652093:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263519.163485:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263509/real 1788263509] req@ffff99438118bb80 x1875129753779712/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263519 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263519.163536:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99438118bb80 x1875129753779712/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788263519 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788263519.163562:0:3319:0:(import.c:65:import_set_state_nolock()) ffff9943803e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788263519.163614:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1875129753779712:0@lo:39:umount.0 00000100:00080000:0.0:1788263519.176791:0:17945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788263519.176805:0:17945:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788263519.176814:0:17945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788263519.177730:0:17945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263519.177748:0:17945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263519.177756:0:17945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263519.177763:0:17945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263519.177795:0:17945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263519.177804:0:17945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263519.177811:0:17945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263519.177818:0:17945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263519.177823:0:17945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263519.177839:0:17945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788263519.177843:0:17945:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788263519.177887:0:17945:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788263519.177892:0:17945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788263519.177897:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788263519.177904:0:17945:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788263519.177909:0:17945:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff994346b319b8) has no exports 00000020:00080000:0.0:1788263519.177942:0:17945:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff994346b319b8) has no exports 00010000:00010000:2.0:1788263519.179170:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788263519.179184:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263519.179196:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263519.179200:0:14485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263519.179212:0:14485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263519.179253:0:14485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263519.179260:0:14485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788263519.179263:0:14485:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788263519.179266:0:14485:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788263519.179288:0:14485:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942421ac800 00010000:00010000:2.0:1788263519.179293:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263519.179300:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99438216ce00/0x1a657bc513956d9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956da5 expref: -99 pid: 15900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263519.179327:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263519.179331:0:14485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263519.179338:0:14485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242899600 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263519.179355:0:14485:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263519.179363:0:14485:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263519.179369:0:14485:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263519.179374:0:14485:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788263519.179377:0:14485:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788263519.179378:0:14485:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788263519.179385:0:14485:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942421ac800 00010000:00010000:2.0:1788263519.179388:0:14485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263519.179394:0:14485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994242899600/0x1a657bc513956f50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956f57 expref: -99 pid: 14494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263519.179409:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263519.179411:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263519.179413:0:14485:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263519.179761:0:14486:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788263519.184122:0:17945:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994379f1ca80 - data ffff99437fec8870/ffff994243684c00 00000020:01000000:0.0:1788263519.184588:0:17945:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff994349cde600 - data ffff99436dac7288/ffff9942435e3000 00100000:10000000:0.0:1788263519.198693:0:17945:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788263519.231496:0:17945:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956db3 00000020:00000080:2.0:1788263519.231510:0:17945:0:(genops.c:885:class_export_put()) final put ffff994346b74800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788263519.231564:0:17945:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9943803c6000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788263519.231569:0:17945:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9943803c6000 2 00000020:01000004:2.0:1788263519.231573:0:17945:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9943803c6000 from lustre-OST0001 00000020:00000080:2.0:1788263519.231605:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263519.231618:0:17945:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788263519.231622:0:17945:0:(genops.c:885:class_export_put()) final put ffff9943803ee000/lustre-OST0001_UUID 00000020:00000080:2.0:1788263519.231626:0:17945:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803ee000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788263519.231634:0:17945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788263519.231768:0:17945:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 91f17ece-9654-41b2-8823-2d6af9d5176a->MGS 00010000:00010000:2.0:1788263519.231790:0:17945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99438216d200/0x1a657bc513956c5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956c63 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263519.231804:0:17945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99438216d200/0x1a657bc513956c5c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956c63 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263519.231812:0:17945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788263519.231815:0:17945:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788263519.231819:0:17945:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788263519.231838:0:17945:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942421ac800 00010000:00010000:2.0:1788263519.231843:0:17945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99438216d200/0x1a657bc513956c5c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956c63 expref: -99 pid: 15180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263519.231862:0:17945:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263519.231870:0:17945:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263519.231876:0:17945:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788263519.231878:0:17945:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788263519.231880:0:17945:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788263519.231891:0:17945:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9942421ac800 00010000:00010000:2.0:1788263519.231894:0:17945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513956b44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x1a657bc513956b4b expref: -99 pid: 14479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788263519.231913:0:17945:0:(import.c:65:import_set_state_nolock()) ffff9942421ac800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788263519.231917:0:17945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788263519.231920:0:17945:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788263519.231922:0:17945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788263519.231927:0:17945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788263519.231947:0:17945:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff994375bfa680 x1875129753779456/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788263522 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788263519.231982:0:17945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788263519.231986:0:17945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:3.0:1788263519.232068:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:91f17ece-9654-41b2-8823-2d6af9d5176a:3319:1875129753779456:0@lo:250:kworker.0 10000000:01000000:2.0:1788263519.232174:0:17945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788263519.232182:0:17945:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956b2f 00000020:00000080:2.0:1788263519.232188:0:17945:0:(genops.c:885:class_export_put()) final put ffff99437fa29000/91f17ece-9654-41b2-8823-2d6af9d5176a 00000020:00000080:1.0:1788263519.232484:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994346b74800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788263519.232574:0:17945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.129@tcp (flags='') 00000020:00000080:2.0:1788263519.232581:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788263519.232587:0:17945:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788263519.232591:0:17945:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff994346b34d28) has no exports 10000000:01000000:3.0:1788263519.232653:0:14494:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788263519.232746:0:17945:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.129@tcp: client import never connected 00000100:00080000:2.0:1788263519.232750:0:17945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788263519.232752:0:17945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788263519.232754:0:17945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788263519.232757:0:17945:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788263519.232787:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99437fa29000/91f17ece-9654-41b2-8823-2d6af9d5176a for MGC192.168.201.129@tcp 00000020:00000080:2.0:1788263519.232953:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788263519.232959:0:17945:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.129@tcp (uuid 91f17ece-9654-41b2-8823-2d6af9d5176a) 00000020:01000000:2.0:1788263519.232964:0:17945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788263519.232978:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788263519.232982:0:17945:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788263519.232987:0:17945:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9943803ea800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788263519.232993:0:17945:0:(genops.c:1553:class_disconnect_exports()) OBD device 17 (ffff99424387cd28) has exports, disconnecting them 00000020:00080000:2.0:1788263519.232998:0:17945:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9943803ea800), last request at 1788263442 00000020:00000080:2.0:1788263519.233003:0:17945:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956ddd 00000020:00080000:2.0:1788263519.233015:0:17945:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9943803ea800): rc 0 00000020:00000080:2.0:1788263519.233018:0:17945:0:(genops.c:885:class_export_put()) final put ffff9943803ea800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788263519.233196:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9942421ac800 for MGC192.168.201.129@tcp 00000020:00000080:1.0:1788263519.233204:0:8:0:(genops.c:885:class_export_put()) final put ffff9942421a8800/91f17ece-9654-41b2-8823-2d6af9d5176a 00000020:00000080:1.0:1788263519.233207:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9942421a8800/91f17ece-9654-41b2-8823-2d6af9d5176a for MGC192.168.201.129@tcp 00000020:01000000:1.0:1788263519.233211:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.129@tcp (91f17ece-9654-41b2-8823-2d6af9d5176a) 00000020:00000080:1.0:1788263519.234084:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803ea800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788263519.241509:0:17945:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788263519.241523:0:17945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788263519.241530:0:17945:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788263519.241540:0:17945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788263519.241712:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9943803e9000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1788263519.243345:0:14485:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788263519.243718:0:14486:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1788263519.244255:0:14481:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9943755b0800:14481] 1 exiting: rc = 0 00000100:00100000:3.0:1788263519.245328:0:14480:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9943755b0600:14480] 0 exiting: rc = 1 00000100:00100000:1.0:1788263519.245707:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.246013:0:14482:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff994349e29600:14482] 0 exiting: rc = 1 00000100:00100000:3.0:1788263519.246129:0:14483:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99437f707600:14483] 1 exiting: rc = 0 00000100:00100000:1.0:1788263519.246373:0:14484:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99437f706800:14484] 2 exiting: rc = 0 00000100:00100000:3.0:1788263519.246502:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246511:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246518:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246526:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246534:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246539:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246546:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246551:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246557:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246563:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246585:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246591:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246597:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246603:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246609:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246615:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246621:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246628:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246634:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246641:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246647:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246655:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246661:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246668:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246674:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246680:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246686:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246692:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246698:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246704:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246709:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246715:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246722:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246728:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246734:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246739:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246745:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246751:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246757:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246764:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246770:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246776:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246781:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246788:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246794:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246807:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246813:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246819:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246825:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246831:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246837:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246844:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246850:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246854:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246860:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246866:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246872:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246878:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246884:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246889:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246895:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246902:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246907:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.246913:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788263519.248192:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788263519.248207:0:17945:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788263519.248214:0:17945:0:(genops.c:885:class_export_put()) final put ffff9943803e5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788263519.249789:0:17945:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803e5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788263519.249799:0:17945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788263519.249884:0:17945:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9943803c6000 1 00000020:00000080:3.0:1788263519.249892:0:17945:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x1a657bc513956d97 00000020:00000080:3.0:1788263519.249901:0:17945:0:(genops.c:885:class_export_put()) final put ffff994243366000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788263519.250372:0:17945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788263519.250441:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788263519.250461:0:17945:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788263519.250467:0:17945:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff994243878000) has no exports 00000020:00000080:1.0:1788263519.251351:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff994243366000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788263519.278431:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788263519.278465:0:17945:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788263519.278472:0:17945:0:(genops.c:885:class_export_put()) final put ffff9943803c5000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788263519.278563:0:17945:0:(genops.c:844:class_export_destroy()) destroying export ffff9943803c5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788263519.278573:0:17945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788263519.278823:0:17945:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9943803c0800 00000020:01000000:3.0:1788263519.278851:0:17945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788263519.278856:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788263519.278862:0:17945:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788263519.278867:0:17945:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff99437f9ccd28) has no exports 00000020:00000080:3.0:1788263519.278901:0:17945:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788263519.278909:0:17945:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788263519.278913:0:17945:0:(genops.c:885:class_export_put()) final put ffff9943744bb800/OSS_uuid 00000020:00000080:3.0:1788263519.278915:0:17945:0:(genops.c:844:class_export_destroy()) destroying export ffff9943744bb800/OSS_uuid for OSS 00000020:01000000:3.0:1788263519.278919:0:17945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788263519.278947:0:14493:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788263519.280394:0:15183:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff994377a84c00:15183] 1 exiting: rc = 0 00000100:00100000:3.0:1788263519.282676:0:16378:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff994242693c00:16378] 3 exiting: rc = 0 00000100:00100000:3.0:1788263519.282779:0:16933:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9942421f3c00:16933] 4 exiting: rc = 0 00000100:00100000:3.0:1788263519.282844:0:15184:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9943499d5600:15184] 2 exiting: rc = 0 00000100:00100000:3.0:1788263519.282902:0:15182:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff994346170e00:15182] 0 exiting: rc = 1 00000100:00100000:3.0:1788263519.282983:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.282993:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.282999:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283005:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283011:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283017:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283022:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283028:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283033:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283038:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283043:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283054:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283063:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283069:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283075:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283103:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283112:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283119:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283124:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283130:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283136:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283142:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283150:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283155:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283161:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283169:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283174:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283180:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283185:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283191:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283197:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283204:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283210:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283249:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283256:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283261:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283266:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283272:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283277:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283282:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283288:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283295:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283300:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283307:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283312:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283328:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283334:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283340:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283346:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283351:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283366:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283373:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283378:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283383:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283388:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283394:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283568:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283575:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283580:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283585:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283591:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283596:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283601:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.283607:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.288984:0:15185:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff994377a85400:15185] 0 exiting: rc = 1 00000100:00100000:3.0:1788263519.289264:0:15186:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff994372109200:15186] 1 exiting: rc = 0 00000100:00100000:1.0:1788263519.290175:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290185:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290192:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290198:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290204:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290209:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290243:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290251:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290262:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290269:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290275:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290281:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.290287:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.297279:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.297311:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.297327:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.297350:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.297356:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.297362:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.297368:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.297375:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.297380:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.297387:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.297392:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298061:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298071:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298077:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298082:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298088:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298094:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298100:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298106:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298111:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298117:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298123:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298128:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298133:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298143:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298149:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298155:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298161:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298171:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298176:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298182:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298187:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298194:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298200:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298205:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298212:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298339:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298346:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298364:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298377:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298385:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298392:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298398:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298404:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298411:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298417:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298422:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298428:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298434:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298440:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.298458:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.305676:0:15189:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99435080b200:15189] 2 exiting: rc = 0 00000100:00100000:3.0:1788263519.306114:0:16732:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff99437a58ca00:16732] 3 exiting: rc = 0 00000100:00100000:1.0:1788263519.307907:0:15188:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff994377a85c00:15188] 1 exiting: rc = 0 00000100:00100000:3.0:1788263519.310339:0:15187:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99435080a000:15187] 0 exiting: rc = 1 00000100:00100000:1.0:1788263519.311824:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311837:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311844:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311850:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311857:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311863:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311870:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311875:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311881:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311887:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311893:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311899:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311905:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311911:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311917:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311924:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311930:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311936:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311983:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311992:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.311998:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312021:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312028:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312034:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312040:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312046:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312053:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312059:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312065:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312072:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312078:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312084:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312090:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312096:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312102:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312108:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312114:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312120:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312126:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312132:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312138:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312145:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312164:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312171:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312177:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312183:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312190:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312196:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312203:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312209:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312240:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312247:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312253:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312259:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312266:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312271:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312288:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312294:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312313:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312333:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312340:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312346:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312353:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.312359:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.328350:0:15190:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99437fd7c400:15190] 0 exiting: rc = 1 00000100:00100000:2.0:1788263519.348517:0:15191:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff994349e9d400:15191] 1 exiting: rc = 0 00000100:00100000:1.0:1788263519.348733:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348742:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348750:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348756:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348761:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348767:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348773:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348780:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348787:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348792:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348797:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348803:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348808:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348814:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348819:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348826:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348832:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348838:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348844:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348850:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348856:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348863:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348872:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348877:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348883:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348890:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348895:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348917:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348922:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348928:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348933:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348938:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348943:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348948:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348954:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348960:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348966:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348973:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348980:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348985:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348991:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.348997:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349003:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349009:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349015:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349021:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349026:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349032:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349038:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349047:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349053:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349059:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349065:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349069:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349074:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349080:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349085:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349090:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349095:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349100:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349106:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349111:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349125:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788263519.349130:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788263519.350462:0:15192:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff994375bf2c00:15192] 0 exiting: rc = 1 00000100:00100000:1.0:1788263519.350748:0:15193:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99437f707c00:15193] 1 exiting: rc = 0 00000100:00100000:2.0:1788263519.350853:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350863:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350869:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350887:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350921:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350930:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350937:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350946:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350952:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350959:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350966:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350974:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350983:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350990:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.350997:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351005:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351026:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351034:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351045:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351055:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351063:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351072:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351078:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351085:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351093:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351100:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351107:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351114:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351135:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351143:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351150:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351158:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351166:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351172:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351179:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351187:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351194:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351200:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351242:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351250:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351270:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351279:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351285:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351292:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351299:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351307:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351324:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351331:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351338:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351344:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351350:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351356:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351377:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351384:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351391:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351398:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351405:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351411:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351419:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351426:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351435:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351441:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351448:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788263519.351455:0:17945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788263519.361132:0:17945:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788263540.712764:0:18561:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788263551.553477:0:19022:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788263551.553483:0:19022:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788263551.553602:0:19022:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99437fb8c000 00000020:01000004:1.0:1788263551.553616:0:19022:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788263551.553623:0:19022:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788263551.553635:0:19022:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff994346b34d28) 00000020:00000080:1.0:1788263551.553645:0:19022:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788263551.580397:0:19022:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788263551.582496:0:19022:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1788263551.583025:0:19022:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788263551.583092:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 433: rc = 0 00100000:10000000:2.0:1788263551.583184:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 433: rc = 0 00100000:10000000:2.0:1788263551.583587:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 433: rc = 0 00100000:10000000:2.0:1788263551.585625:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 433: rc = 0 00100000:10000000:3.0:1788263551.593866:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 433: rc = 0 00100000:10000000:3.0:1788263551.594040:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 433: rc = 0 00100000:10000000:3.0:1788263551.594353:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 435: rc = 0 00100000:10000000:3.0:1788263551.596030:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 770: rc = 0 00100000:10000000:3.0:1788263551.596113:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 770: rc = 0 00100000:10000000:3.0:1788263551.596610:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1788263551.597124:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00100000:10000000:3.0:1788263551.597454:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1788263551.598054:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:3.0:1788263551.598444:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:3.0:1788263551.598830:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1788263551.599097:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1788263551.599429:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1788263551.599637:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 641: rc = 0 00100000:10000000:3.0:1788263551.600055:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1788263551.600373:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 641: rc = 0 00100000:10000000:3.0:1788263551.600608:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:3.0:1788263551.601254:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 574: rc = 0 00100000:10000000:3.0:1788263551.601484:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 574: rc = 0 00100000:10000000:3.0:1788263551.602185:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 574: rc = 0 00100000:10000000:3.0:1788263551.602544:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 574: rc = 0 00100000:10000000:3.0:1788263551.603403:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 574: rc = 0 00100000:10000000:3.0:1788263551.603650:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 574: rc = 0 00100000:10000000:3.0:1788263551.604188:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 574: rc = 0 00100000:10000000:3.0:1788263551.604513:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 574: rc = 0 00100000:10000000:3.0:1788263551.605065:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 574: rc = 0 00100000:10000000:3.0:1788263551.605314:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 574: rc = 0 00100000:10000000:3.0:1788263551.605542:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 574: rc = 0 00100000:10000000:3.0:1788263551.606048:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 574: rc = 0 00100000:10000000:3.0:1788263551.606408:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 574: rc = 0 00100000:10000000:3.0:1788263551.606639:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 574: rc = 0 00100000:10000000:3.0:1788263551.607404:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 574: rc = 0 00100000:10000000:3.0:1788263551.607651:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 574: rc = 0 00100000:10000000:3.0:1788263551.608131:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 574: rc = 0 00100000:10000000:3.0:1788263551.608468:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 574: rc = 0 00100000:10000000:3.0:1788263551.609049:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 574: rc = 0 00100000:10000000:3.0:1788263551.609310:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 574: rc = 0 00100000:10000000:3.0:1788263551.609535:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 574: rc = 0 00100000:10000000:3.0:1788263551.610038:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 574: rc = 0 00100000:10000000:3.0:1788263551.610404:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 574: rc = 0 00100000:10000000:3.0:1788263551.610649:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 574: rc = 0 00100000:10000000:3.0:1788263551.611636:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 574: rc = 0 00100000:10000000:3.0:1788263551.612149:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 574: rc = 0 00100000:10000000:3.0:1788263551.616053:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 574: rc = 0 00100000:10000000:3.0:1788263551.616910:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 574: rc = 0 00100000:10000000:3.0:1788263551.617157:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 574: rc = 0 00100000:10000000:3.0:1788263551.617432:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 574: rc = 0 00100000:10000000:3.0:1788263551.617894:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 574: rc = 0 00100000:10000000:3.0:1788263551.618166:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 574: rc = 0 00100000:10000000:2.0:1788263551.619015:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 655: rc = 0 00100000:10000000:2.0:1788263551.619610:0:19022:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788263551.619940:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:2.0:1788263551.620102:0:19022:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788263551.620156:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:2.0:1788263551.620358:0:19022:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788263551.620410:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:2.0:1788263551.620723:0:19022:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788263551.620975:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 771: rc = 0 00100000:10000000:2.0:1788263551.621151:0:19022:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788263551.621207:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 771: rc = 0 00100000:10000000:2.0:1788263551.621463:0:19022:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788263551.621513:0:19022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 771: rc = 0 00000020:00000080:2.0:1788263551.622047:0:19022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788263551.622054:0:19022:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788263551.622063:0:19022:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc51395720c 00000020:01000004:2.0:1788263551.622070:0:19022:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788263551.622075:0:19022:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788263551.622080:0:19022:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99437fb8c000 from MGS 00000020:01000004:2.0:1788263551.622083:0:19022:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788263551.622093:0:19022:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9942438799b8) 00000020:00000080:2.0:1788263551.622101:0:19022:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788263551.622154:0:19022:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99437fb8c000 from MGS, refs=2 00080000:01000000:2.0:1788263551.622158:0:19022:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788263551.622163:0:19022:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc51395721a 00000100:00100000:2.0:1788263551.622312:0:19022:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788263551.622430:0:19022:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788263551.622435:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788263551.623069:0:19022:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788263551.623076:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788263551.623934:0:19022:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263551.624095:0:19022:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788263551.624100:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788263551.631776:0:19022:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788263551.631795:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788263551.632550:0:19022:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788263551.632558:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788263551.633375:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263551.633379:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263551.633380:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263551.633683:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263551.633686:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263551.633688:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263551.635596:0:19022:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788263551.638706:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788263551.649451:0:19022:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788263551.649472:0:19022:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788263551.649475:0:19022:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788263551.659783:0:19031:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788263551.663052:0:19022:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788263551.663153:0:19022:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788263551.663598:0:19022:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788263551.664031:0:19022:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263551.664186:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788263551.664193:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788263551.666280:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788263551.666292:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788263551.671212:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788263551.671252:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788263551.674305:0:19022:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788263551.674330:0:19022:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.129@tcp' 00000020:01000004:1.0:1788263551.674332:0:19022:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788263551.674364:0:19022:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.129@tcp (typ=mgc) 00000020:00000080:1.0:1788263551.674377:0:19022:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.129@tcp (ffff994346b319b8) 00000020:00000080:1.0:1788263551.674402:0:19022:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788263551.674473:0:19022:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99434660a000@MGC192.168.201.129@tcp: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788263551.674628:0:19022:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.129@tcp-0 is initialized 00000040:01000000:1.0:1788263551.674635:0:19022:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788263551.674879:0:19036:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788263551.684925:0:19037:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788263551.685159:0:19022:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.129@tcp (uuid a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2) 00000020:00000080:1.0:1788263551.685186:0:19022:0:(genops.c:1385:class_connect()) connect: client a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2, cookie 0x1a657bc513957228 00000100:00080000:1.0:1788263551.685200:0:19022:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788263551.685207:0:19022:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff99434660a000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263551.685282:0:19022:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994375bf9880 x1875129753779840/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788263551.685308:0:19022:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2->MGS 00000020:01000004:1.0:1788263551.685335:0:19022:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788263551.685340:0:19022:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788263551.685353:0:19022:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff994346b30000) 00000020:00000080:1.0:1788263551.685364:0:19022:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788263551.685576:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3319:1875129753779840:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788263551.685641:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263551.685703:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753779840 00000100:00100000:0.0:1788263551.685710:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753779840 00000100:00100000:0.0:1788263551.685801:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263551.685808:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3319:x1875129753779840:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788263551.685829:0:19033:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2@0@lo t0 exp 0000000000000000 cur 578 last 0 00000020:00000080:0.0:1788263551.685854:0:19033:0:(genops.c:1385:class_connect()) connect: client a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2, cookie 0x1a657bc513957236 00000100:00080000:0.0:1788263551.685973:0:19033:0:(import.c:65:import_set_state_nolock()) ffff994355944000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263551.686022:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+5:3319:x1875129753779840:12345-0@lo:250:mount.lustre.0 Request processed in 212us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263551.686030:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263551.686061:0:3319:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788263551.686067:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.129@tcp: connect to target with instance 0 00000100:00080000:0.0:1788263551.686074:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788263551.686078:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788263551.686081:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99434660a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788263551.686083:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788263551.686095:0:3319:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788263551.686111:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3319:1875129753779840:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788263551.698933:0:19022:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263551.699122:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788263551.699129:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788263551.712816:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788263551.712830:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788263551.713328:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788263551.713336:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788263551.722772:0:19022:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788263551.722988:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788263551.722995:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788263551.723901:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788263551.723911:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788263551.754994:0:19022:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263551.755200:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788263551.755207:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788263551.756441:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788263551.756449:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788263551.757612:0:19022:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788263551.757801:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788263551.757807:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788263551.758385:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788263551.758392:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788263551.759099:0:19022:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263551.759422:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788263551.759427:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788263551.760048:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788263551.760055:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788263551.760710:0:19022:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263551.760878:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788263551.760883:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788263551.761450:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788263551.761458:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788263551.779867:0:19022:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263551.780079:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788263551.780085:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788263551.782015:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788263551.782028:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788263551.782995:0:19022:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788263551.783004:0:19022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788263551.784322:0:19022:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788263551.784350:0:19022:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788263551.784357:0:19022:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788263551.784507:0:19022:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788263551.784648:0:19022:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788263551.784729:0:19022:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788263551.784732:0:19022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788263551.784733:0:19022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263551.784734:0:19022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263551.784735:0:19022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263551.784737:0:19022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263551.784739:0:19022:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788263551.784740:0:19022:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788263551.784741:0:19022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263551.784743:0:19022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788263551.784746:0:19022:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788263551.784759:0:19022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788263551.784760:0:19022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788263551.784761:0:19022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263551.784762:0:19022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263551.784763:0:19022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263551.784765:0:19022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263551.784766:0:19022:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788263551.784767:0:19022:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788263551.784768:0:19022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263551.784769:0:19022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788263551.784795:0:19022:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788263551.784815:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753779968:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788263551.784906:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263551.784990:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff994346917300 going to sleep for 11 seconds 00000100:00100000:3.0:1788263551.785055:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753779968 00000100:00100000:3.0:1788263551.785063:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753779968 00000100:00100000:3.0:1788263551.785106:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263551.785116:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+5:19022:x1875129753779968:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788263551.785158:0:19035:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788263551.785162:0:19035:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788263551.785165:0:19035:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788263551.785846:0:19056:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788263551.786201:0:19035:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:0.0:1788263551.787382:0:19057:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788263551.787388:0:19057:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788263551.787391:0:19057:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788263551.787426:0:19057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788263551.787849:0:19035:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788263551.787860:0:19035:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788263551.795054:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+5:19022:x1875129753779968:12345-0@lo:253:mount.lustre.0 Request processed in 9930us (10138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263551.795076:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263551.795166:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753779968:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788263551.795181:0:19022:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788263551.795184:0:19022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263551.795186:0:19022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263551.795187:0:19022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263551.795188:0:19022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263551.795189:0:19022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263551.795190:0:19022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263551.795191:0:19022:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263551.795193:0:19022:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263551.795195:0:19022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263551.795196:0:19022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788263551.795410:0:19022:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99437fb8c000 from lustre-MDT0000 10000000:01000000:2.0:1788263551.795437:0:19022:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788263551.795440:0:19022:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788263551.795444:0:19022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff994346b319b8 10000000:01000000:2.0:1788263551.795465:0:19022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263551.795472:0:19022:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff994346b319b8 from 1 10000000:01000000:2.0:1788263551.795475:0:19022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788263551.795514:0:19022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.795526:0:19022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.795535:0:19022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263551.795638:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263551.795690:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263551.795727:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263551.795853:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753780096 00000100:00100000:0.0:1788263551.795861:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753780096 00000100:00100000:0.0:1788263551.795906:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263551.795916:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+5:19022:x1875129753780096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263551.795929:0:19033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263551.795944:0:19033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994382043400/0x1a657bc513957244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395723d expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.795967:0:19033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994382043400/0x1a657bc513957244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395723d expref: 6 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.795978:0:19033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994382043400/0x1a657bc513957244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395723d expref: 6 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.795987:0:19033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382043400, rc 0) 00000100:00100000:0.0:1788263551.796027:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+6:19022:x1875129753780096:12345-0@lo:101:mount.lustre.0 Request processed in 113us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263551.796033:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263551.796152:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780096:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263551.796166:0:19022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957244 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.796175:0:19022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513957244 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263551.796249:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263551.796276:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263551.796347:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788263551.796645:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753780224 00000100:00100000:1.0:1788263551.796766:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753780224 00000100:00100000:1.0:1788263551.796837:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788263551.796845:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+6:19022:x1875129753780224:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263551.797071:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+6:19022:x1875129753780224:12345-0@lo:501:mount.lustre.0 Request processed in 227us (794us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788263551.797078:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263551.797141:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780224:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788263551.797168:0:19022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788263551.797189:0:19022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957244 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.797206:0:19022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957244 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263551.797239:0:19022:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99437fb8c000 10000000:01000000:2.0:1788263551.797245:0:19022:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788263551.797250:0:19022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99437fb8c000 10000000:01000000:2.0:1788263551.797253:0:19022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788263551.797256:0:19022:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99437fb8c000 from 1 10000000:01000000:2.0:1788263551.797259:0:19022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788263551.797283:0:19022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658600/0x1a657bc51395724b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.797291:0:19022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994380658600/0x1a657bc51395724b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.797299:0:19022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994380658600/0x1a657bc51395724b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263551.797314:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263551.797343:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263551.797565:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263551.797774:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753780352 00000100:00100000:0.0:1788263551.797785:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753780352 00000100:00100000:0.0:1788263551.797808:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788263551.797815:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+6:19022:x1875129753780352:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263551.797824:0:19033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263551.797837:0:19033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994382043e00/0x1a657bc513957252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395724b expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.797857:0:19033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994382043e00/0x1a657bc513957252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395724b expref: 7 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.797867:0:19033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994382043e00/0x1a657bc513957252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395724b expref: 7 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.797875:0:19033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382043e00, rc 0) 00000100:00100000:0.0:1788263551.797916:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+7:19022:x1875129753780352:12345-0@lo:101:mount.lustre.0 Request processed in 102us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263551.797923:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263551.798049:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780352:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263551.798061:0:19022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994380658600/0x1a657bc51395724b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957252 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.798070:0:19022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994380658600/0x1a657bc51395724b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513957252 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263551.798093:0:19022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788263551.798111:0:19022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658600/0x1a657bc51395724b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957252 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.798118:0:19022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380658600/0x1a657bc51395724b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957252 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263551.798124:0:19022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788263551.798129:0:19022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263551.798133:0:19022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99437fb8c000 10000000:01000000:2.0:1788263551.798135:0:19022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788263551.798138:0:19022:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788263551.798140:0:19022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788263551.798156:0:19022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513957259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.798163:0:19022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513957259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.798170:0:19022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513957259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263551.798184:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263551.798209:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263551.798247:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263551.798321:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753780480 00000100:00100000:0.0:1788263551.798325:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753780480 00000100:00100000:0.0:1788263551.798342:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788263551.798347:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+7:19022:x1875129753780480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263551.798354:0:19033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263551.798362:0:19033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994382042200/0x1a657bc513957260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513957259 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.798376:0:19033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994382042200/0x1a657bc513957260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513957259 expref: 8 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.798383:0:19033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994382042200/0x1a657bc513957260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513957259 expref: 8 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.798396:0:19033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994382042200, rc 0) 00000100:00100000:0.0:1788263551.798423:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+8:19022:x1875129753780480:12345-0@lo:101:mount.lustre.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263551.798429:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263551.798494:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263551.798504:0:19022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513957259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957260 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.798517:0:19022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513957259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513957260 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263551.798572:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263551.798598:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263551.798625:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263551.798855:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753780608 00000100:00100000:0.0:1788263551.798861:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753780608 00000100:00100000:0.0:1788263551.798879:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788263551.798885:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+8:19022:x1875129753780608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263551.799247:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+9:19022:x1875129753780608:12345-0@lo:501:mount.lustre.0 Request processed in 360us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263551.799254:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263551.799320:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263551.799346:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263551.799379:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263551.799404:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788263551.799448:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753780736 00000100:00100000:0.0:1788263551.799452:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753780736 00000100:00100000:0.0:1788263551.799467:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788263551.799473:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+9:19022:x1875129753780736:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263551.799920:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+9:19022:x1875129753780736:12345-0@lo:503:mount.lustre.0 Request processed in 445us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263551.799927:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788263551.799996:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753780736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263551.800460:0:19058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19058:1875129753780864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263551.800495:0:19058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263551.800518:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753780864 00000100:00100000:0.0:1788263551.800523:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753780864 00000100:00100000:0.0:1788263551.800645:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263551.800762:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+9:19058:x1875129753780864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788263551.800980:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+9:19058:x1875129753780864:12345-0@lo:502:llog_process_th.0 Request processed in 327us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263551.800992:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788263551.801076:0:19058:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437a573600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263551.801090:0:19058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19058:1875129753780864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788263551.801111:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263551.801122:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263551.801124:0:19058:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788263551.801128:0:19058:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788263551.801131:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263551.801144:0:19058:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99437f9ccd28) 00000020:00000080:0.0:1788263551.801160:0:19058:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788263551.801164:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788263551.801372:0:19058:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788263551.801378:0:19058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc51395726e 00000020:00000080:0.0:1788263551.801640:0:19058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788263551.801644:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263551.801648:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263551.801780:0:19058:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788263551.801785:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788263551.801789:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263551.801791:0:19058:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788263551.801794:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263551.801801:0:19058:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99437f9c8000) 00000020:00000080:0.0:1788263551.801811:0:19058:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788263551.801814:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788263551.801816:0:19058:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788263551.801818:0:19058:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788263551.801823:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788263551.801878:0:19058:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99437fb8c000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788263551.801890:0:19058:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99437f9cb370) 00000020:00000080:0.0:1788263551.801897:0:19058:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788263551.801949:0:19058:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788263551.801956:0:19058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc513957283 00000020:00000080:0.0:1788263551.802040:0:19058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788263551.802046:0:19058:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788263551.802049:0:19058:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x1a657bc51395728a 00080000:01000000:0.0:1788263551.802054:0:19058:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788263551.802057:0:19058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc513957291 00010000:00010000:2.0:1788263551.864461:0:19058:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788263551.864988:0:19058:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:2.0:1788263551.865165:0:19058:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788263551.865918:0:19058:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99424387b370) 00000020:00000080:2.0:1788263551.865936:0:19058:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788263551.866016:0:19058:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788263551.866023:0:19058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc51395729f 00000020:00000080:0.0:1788263551.868742:0:19058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788263551.875214:0:19058:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x1a657bc5139572a6 00000020:00000080:2.0:1788263551.875913:0:19058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788263551.875926:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263551.875934:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263551.875936:0:19058:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788263551.875941:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788263551.875944:0:19058:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788263551.875946:0:19058:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788263551.875948:0:19058:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788263551.875957:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788263551.875961:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263551.875962:0:19058:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788263551.875966:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263551.875971:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263551.875973:0:19058:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788263551.875978:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788263551.876019:0:19058:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788263551.876038:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263551.876042:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263551.876043:0:19058:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788263551.876046:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788263551.876050:0:19058:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788263551.876053:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263551.876054:0:19058:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788263551.876057:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788263551.876061:0:19058:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:2.0:1788263551.876086:0:19058:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788263551.876088:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788263551.876102:0:19058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff994243878000) 00000020:00000080:2.0:1788263551.876115:0:19058:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788263551.876118:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788263551.876169:0:19058:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788263551.876176:0:19058:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788263551.876182:0:19058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc5139572b4 00010000:00080000:2.0:1788263551.876243:0:19058:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99437f52b800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1788263551.876502:0:19058:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788263551.878063:0:19058:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788263551.878115:0:19058:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788263551.880307:0:19058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263551.880374:0:19058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788263551.880462:0:19058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788263551.881147:0:19062:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788263551.881151:0:19062:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788263551.881822:0:19058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788263551.881834:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788263551.881867:0:19058:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788263551.881887:0:19058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc5139572bb 00000100:00080000:0.0:1788263551.881896:0:19058:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788263551.881901:0:19058:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99437f52b800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788263551.881934:0:19058:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994381189880 x1875129753780992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263551.882002:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753780992:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788263551.882062:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129753780992 offset 0 length 520: 4 00000100:00080000:0.0:1788263551.882115:0:19058:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788263551.882203:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788263551.882208:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263551.882210:0:19058:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788263551.882213:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788263551.882238:0:19058:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1788263551.882240:0:19058:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263551.882242:0:19058:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788263551.882243:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788263551.882246:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263551.882248:0:19058:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788263551.882251:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788263551.882255:0:19058:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788263551.882259:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263551.882261:0:19058:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788263551.882271:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788263551.882275:0:19058:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:0.0:1788263551.882296:0:19058:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788263551.882299:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263551.882310:0:19058:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99437f9c99b8) 00000020:00000080:0.0:1788263551.882322:0:19058:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788263551.882327:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788263551.882391:0:19058:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788263551.882397:0:19058:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788263551.882403:0:19058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x1a657bc5139572c9 00010000:00080000:0.0:1788263551.882430:0:19058:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994375e65800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:0.0:1788263551.882632:0:19058:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788263551.882876:0:19058:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788263551.882896:0:19058:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788263551.883441:0:19058:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788263551.883509:0:19058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1788263551.883576:0:19058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1788263551.884467:0:19064:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788263551.884472:0:19064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788263551.885607:0:19058:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788263551.885619:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788263551.885712:0:19058:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788263551.885734:0:19058:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc5139572d0 00000100:00080000:2.0:1788263551.885744:0:19058:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788263551.885761:0:19058:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994375e65800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788263551.885798:0:19058:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994379f24000 x1875129753781120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788263551.885861:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753781120:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788263551.885918:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129753781120 offset 0 length 520: 4 00000100:00080000:2.0:1788263551.885974:0:19058:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788263551.886074:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263551.886079:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263551.886081:0:19058:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788263551.886085:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263551.886089:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263551.886090:0:19058:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788263551.886094:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788263551.886095:0:19058:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788263551.886098:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263551.886100:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263551.886102:0:19058:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788263551.886105:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788263551.886107:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263551.886108:0:19058:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788263551.886111:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788263551.886140:0:19058:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19058:1875129753781248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263551.886192:0:19058:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263551.886268:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753781248 00000100:00100000:2.0:1788263551.886275:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753781248 00000100:00100000:2.0:1788263551.886314:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788263551.886323:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+9:19058:x1875129753781248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263551.886542:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+9:19058:x1875129753781248:12345-0@lo:502:llog_process_th.0 Request processed in 219us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263551.886549:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788263551.886585:0:19058:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263551.886604:0:19058:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19058:1875129753781248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263551.886625:0:19058:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263551.886629:0:19058:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263551.886630:0:19058:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788263551.886634:0:19058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788263551.886691:0:19022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788263551.886708:0:19022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788263551.886723:0:19022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513957259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957260 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.886733:0:19022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380658200/0x1a657bc513957259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957260 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263551.886741:0:19022:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99437fb8c000 from 1 10000000:01000000:2.0:1788263551.886744:0:19022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788263551.886779:0:19022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.886787:0:19022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.886806:0:19022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263551.886818:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753781376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263551.886844:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263551.886860:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263551.887005:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753781376 00000100:00100000:1.0:1788263551.887010:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753781376 00000100:00100000:1.0:1788263551.887041:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788263551.887049:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+9:19022:x1875129753781376:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263551.887058:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263551.887072:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242898c00/0x1a657bc5139572de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139572d7 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263551.887091:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242898c00/0x1a657bc5139572de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139572d7 expref: 10 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263551.887101:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242898c00/0x1a657bc5139572de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139572d7 expref: 10 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263551.887110:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242898c00, rc 0) 00000100:00100000:1.0:1788263551.887137:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+10:19022:x1875129753781376:12345-0@lo:101:mount.lustre.0 Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263551.887143:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263551.887334:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753781376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263551.887346:0:19022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.887356:0:19022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263551.887960:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753781504:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788263551.887999:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263551.888062:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943462e0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263551.888524:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753781504 00000100:00100000:1.0:1788263551.888531:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753781504 00000100:00100000:1.0:1788263551.888559:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263551.888567:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+10:19022:x1875129753781504:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788263551.888583:0:19035:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788263551.888588:0:19035:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788263551.888671:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+10:19022:x1875129753781504:12345-0@lo:256:mount.lustre.0 Request processed in 104us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263551.888677:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263551.888818:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753781504:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788263551.889382:0:19022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788263551.889401:0:19022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.889411:0:19022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263551.889420:0:19022:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99437fb8c000 from 1 10000000:01000000:3.0:1788263551.889423:0:19022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263551.889474:0:19022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.889481:0:19022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.889490:0:19022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263551.889507:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753781632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263551.889543:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263551.889580:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff994356683480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263551.889996:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753781632 00000100:00100000:2.0:1788263551.890002:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753781632 00000100:00100000:2.0:1788263551.890029:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788263551.890037:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+10:19022:x1875129753781632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263551.890048:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263551.890062:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994380658800/0x1a657bc5139572ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139572e5 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.890083:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380658800/0x1a657bc5139572ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139572e5 expref: 11 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.890109:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994380658800/0x1a657bc5139572ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139572e5 expref: 11 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.890118:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658800, rc 0) 00000100:00100000:2.0:1788263551.890154:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19022:x1875129753781632:12345-0@lo:101:mount.lustre.0 Request processed in 118us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263551.890160:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788263551.890355:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753781632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263551.890369:0:19022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.890377:0:19022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263551.890439:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753781760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263551.890463:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263551.890492:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff994356683480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263551.890548:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753781760 00000100:00100000:2.0:1788263551.890552:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753781760 00000100:00100000:2.0:1788263551.890578:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263551.890584:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19022:x1875129753781760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263551.891017:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19022:x1875129753781760:12345-0@lo:501:mount.lustre.0 Request processed in 432us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263551.891023:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788263551.891128:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753781760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263551.891156:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753781888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263551.891192:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263551.891245:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff994356683480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263551.891335:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753781888 00000100:00100000:2.0:1788263551.891340:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753781888 00000100:00100000:2.0:1788263551.891370:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788263551.891378:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19022:x1875129753781888:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263551.891513:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19022:x1875129753781888:12345-0@lo:503:mount.lustre.0 Request processed in 136us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263551.891520:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788263551.891625:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753781888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263551.892336:0:19066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19066:1875129753782016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263551.892378:0:19066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263551.892445:0:19066:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943455d0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263551.892485:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753782016 00000100:00100000:2.0:1788263551.892490:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753782016 00000100:00100000:2.0:1788263551.892561:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788263551.892569:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19066:x1875129753782016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788263551.892796:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19066:x1875129753782016:12345-0@lo:502:llog_process_th.0 Request processed in 227us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263551.892809:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788263551.892878:0:19066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19066:1875129753782016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788263551.892900:0:19066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263551.892908:0:19066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263551.892911:0:19066:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788263551.892917:0:19066:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99437fb8c000 00000020:00000080:3.0:1788263551.892920:0:19066:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263551.892930:0:19066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263551.892932:0:19066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263551.892933:0:19066:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788263551.892936:0:19066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263551.892938:0:19066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263551.892939:0:19066:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788263551.892941:0:19066:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99437fb8c000 00000020:00000080:3.0:1788263551.892943:0:19066:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263551.893007:0:19066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263551.893011:0:19066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263551.893012:0:19066:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788263551.893014:0:19066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263551.893016:0:19066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263551.893017:0:19066:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788263551.893021:0:19066:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99437fb8c000 00000020:00000080:3.0:1788263551.893022:0:19066:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788263551.893056:0:19066:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19066:1875129753782144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263551.893088:0:19066:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263551.902765:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753782144 00000100:00100000:1.0:1788263551.902780:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753782144 00000100:00100000:1.0:1788263551.902834:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263551.902845:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19066:x1875129753782144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788263551.903090:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19066:x1875129753782144:12345-0@lo:502:llog_process_th.0 Request processed in 246us (10000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263551.903098:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788263551.909801:0:19066:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943455d0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788263551.909845:0:19066:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19066:1875129753782144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788263551.909885:0:19066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788263551.909894:0:19066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788263551.909897:0:19066:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788263551.909903:0:19066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788263551.910178:0:19022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788263551.910198:0:19022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263551.910284:0:19022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.910296:0:19022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263551.910340:0:19022:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788263551.910348:0:19022:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99437fb8c000 10000000:01000000:0.0:1788263551.910351:0:19022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99437fb8c000 10000000:01000000:0.0:1788263551.910355:0:19022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788263551.910360:0:19022:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99437fb8c000 from 1 10000000:01000000:0.0:1788263551.910362:0:19022:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788263551.910394:0:19022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994382042400/0x1a657bc5139572f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.910401:0:19022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994382042400/0x1a657bc5139572f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.910409:0:19022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994382042400/0x1a657bc5139572f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263551.910425:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753782272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788263551.910482:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263551.910722:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753782272 00000100:00100000:1.0:1788263551.910728:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753782272 00000100:00100000:1.0:1788263551.910810:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788263551.910821:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19022:x1875129753782272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263551.910834:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263551.910847:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242898200/0x1a657bc5139572fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139572f3 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263551.910869:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242898200/0x1a657bc5139572fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139572f3 expref: 12 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263551.910879:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242898200/0x1a657bc5139572fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139572f3 expref: 12 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263551.910894:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242898200, rc 0) 00000100:00100000:1.0:1788263551.910928:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19022:x1875129753782272:12345-0@lo:101:mount.lustre.0 Request processed in 109us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263551.910934:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788263551.910982:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788263551.910997:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753782272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263551.911009:0:19022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994382042400/0x1a657bc5139572f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139572fa expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.911017:0:19022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994382042400/0x1a657bc5139572f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139572fa expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263551.911057:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753782400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263551.911082:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263551.911171:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788263551.911757:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753782400 00000100:00100000:2.0:1788263551.911763:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753782400 00000100:00100000:2.0:1788263551.911791:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788263551.911798:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19022:x1875129753782400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263551.912058:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19022:x1875129753782400:12345-0@lo:501:mount.lustre.0 Request processed in 260us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263551.912066:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788263551.912195:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753782400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263551.914827:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753782528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263551.914905:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263551.914944:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fb7b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788263551.915041:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753782528 00000100:00100000:3.0:1788263551.915048:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753782528 00000100:00100000:3.0:1788263551.915102:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788263551.915112:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19022:x1875129753782528:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263551.915334:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19022:x1875129753782528:12345-0@lo:503:mount.lustre.0 Request processed in 224us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263551.915343:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788263551.915487:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753782528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263551.915885:0:19072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19072:1875129753782656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263551.915927:0:19072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263551.915948:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753782656 00000100:00100000:3.0:1788263551.915952:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753782656 00000100:00100000:3.0:1788263551.915984:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263551.915991:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19072:x1875129753782656:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263551.916155:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19072:x1875129753782656:12345-0@lo:502:llog_process_th.0 Request processed in 165us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263551.916163:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788263551.916198:0:19072:0:(client.c:2715:ptlrpc_set_wait()) set ffff994356683480 going to sleep for 11 seconds 00000100:00100000:3.0:1788263551.916210:0:19072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19072:1875129753782656:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788263551.916291:0:19072:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788263551.916304:0:19072:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9942421b3370) 00000020:00000080:3.0:1788263551.916322:0:19072:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788263551.916386:0:19072:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99437fb8c000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788263551.916390:0:19072:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99437fb8c000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788263551.916392:0:19072:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99437fb8c000 4 00010000:00080000:3.0:1788263551.916430:0:19072:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99438144f000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:3.0:1788263551.920273:0:19072:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788263551.920467:0:19072:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788263551.920506:0:19072:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788263551.920523:0:19072:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x1a657bc513957308 00000100:00080000:3.0:1788263551.920534:0:19072:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788263551.920540:0:19072:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99438144f000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788263551.920577:0:19072:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9943755bdf80 x1875129753782784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263551.920618:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753782784:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788263551.923821:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788263551.923899:0:19072:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788263551.925088:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753782784 00000100:00100000:1.0:1788263551.925102:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753782784 00000100:00100000:1.0:1788263551.925146:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263551.925155:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1875129753782784:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788263551.925259:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1875129753782784:12345-0@lo:38:llog_process_th.0 Request processed in 103us (1445us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788263551.925267:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263551.925330:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788263551.925339:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99438144f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788263551.925344:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788263551.925347:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753782784:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788263551.932238:0:19072:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19072:1875129753782912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263551.932322:0:19072:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263551.932356:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753782912 00000100:00100000:3.0:1788263551.932362:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753782912 00000100:00100000:3.0:1788263551.932404:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788263551.932413:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19072:x1875129753782912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788263551.932678:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19072:x1875129753782912:12345-0@lo:502:llog_process_th.0 Request processed in 264us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263551.932695:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788263551.932758:0:19072:0:(client.c:2715:ptlrpc_set_wait()) set ffff994355abde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788263551.932779:0:19072:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19072:1875129753782912:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788263551.932805:0:19072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788263551.934367:0:19022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788263551.934393:0:19022:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788263551.934408:0:19022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994382042400/0x1a657bc5139572f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139572fa expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263551.934419:0:19022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994382042400/0x1a657bc5139572f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139572fa expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788263551.934469:0:19022:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788263551.934471:0:19022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788263551.934472:0:19022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263551.934477:0:19022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263551.934479:0:19022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263551.934480:0:19022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263551.934481:0:19022:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788263551.934483:0:19022:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788263551.934484:0:19022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263551.934485:0:19022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788263551.934489:0:19022:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788263551.934491:0:19022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788263551.934492:0:19022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788263551.934493:0:19022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263551.934494:0:19022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263551.934495:0:19022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263551.934496:0:19022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263551.934497:0:19022:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788263551.934498:0:19022:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788263551.934499:0:19022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263551.934500:0:19022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788263551.934524:0:19022:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788263551.934541:0:19022:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753783040:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788263551.934596:0:19022:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263551.934615:0:19022:0:(client.c:2715:ptlrpc_set_wait()) set ffff994341254cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263551.934636:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753783040 00000100:00100000:1.0:1788263551.934643:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753783040 00000100:00100000:3.0:1788263551.935068:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788263551.935079:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19022:x1875129753783040:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788263551.935104:0:19034:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788263551.935118:0:19034:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788263551.960386:0:19034:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788263551.960407:0:19034:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788263551.960587:0:19056:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788263551.960592:0:19056:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788263551.960613:0:19056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.960632:0:19056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994242898c00/0x1a657bc5139572de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139572d7 expref: 12 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.960641:0:19056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.960904:0:19056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994242898c00/0x1a657bc5139572de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc5139572d7 expref: 12 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263551.960919:0:19056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994242898c00/0x1a657bc5139572de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc5139572d7 expref: 12 pid: 19035 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263551.960943:0:19056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19056:1875129753783168:0@lo:104: 00000100:00100000:2.0:1788263551.961008:0:19056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263551.961048:0:19056:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263551.961065:0:19023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753783168 00000100:00100000:0.0:1788263551.961073:0:19023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753783168 00000100:00100000:0.0:1788263551.961120:0:19023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263551.961129:0:19023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+3:19056:x1875129753783168:12345-0@lo:104: 00010000:00010000:0.0:1788263551.961142:0:19023:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.961192:0:19023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263551.961198:0:19023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+3:19056:x1875129753783168:12345-0@lo:104: Request processed in 70us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263551.961205:0:19023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263551.961262:0:19056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19056:1875129753783168:0@lo:104: 00010000:00010000:0.0:1788263551.961279:0:19056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.961295:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263551.961301:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.961308:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659400 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263551.961312:0:19029:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.961332:0:19029:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263551.961341:0:19029:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263551.961347:0:19029:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263551.961375:0:19029:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.961382:0:19029:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263551.961409:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.961416:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994380659400/0x1a657bc5139572d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139572de expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263551.961430:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263551.961432:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263551.961433:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263551.961458:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788263551.961467:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3321:1875129753783296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263551.961661:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263551.961799:0:19025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753783296 00000100:00100000:3.0:1788263551.961804:0:19025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753783296 00010000:00010000:3.0:1788263551.961823:0:19025:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994242898c00/0x1a657bc5139572de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139572d7 expref: 13 pid: 19035 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263551.961883:0:19025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263551.961891:0:19025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+13:3321:x1875129753783296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788263551.961902:0:19025:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263551.961908:0:19025:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994242898c00/0x1a657bc5139572de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139572d7 expref: 13 pid: 19035 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.961918:0:19025:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994242898c00/0x1a657bc5139572de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc5139572d7 expref: 13 pid: 19035 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.961930:0:19025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994242898c00/0x1a657bc5139572de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc5139572d7 expref: 13 pid: 19035 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.961944:0:19025:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.961964:0:19025:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788263551.961976:0:19025:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001384810s 00010000:00010000:3.0:1788263551.961980:0:19025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.961987:0:19025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.961993:0:19025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.961999:0:19025:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.962005:0:19025:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263551.962009:0:19025:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.962017:0:19025:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.962037:0:19025:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263551.962046:0:19025:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263551.962078:0:19025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:3321:x1875129753783296:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263551.962086:0:19025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263551.962139:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3321:1875129753783296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263551.962146:0:19056:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263551.962154:0:19056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263551.962160:0:19056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994380658a00/0x1a657bc51395730f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263551.968031:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19022:x1875129753783040:12345-0@lo:253:mount.lustre.0 Request processed in 32945us (33424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263551.968047:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788263551.968161:0:19022:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19022:1875129753783040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788263551.968178:0:19022:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788263551.968182:0:19022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788263551.968184:0:19022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788263551.968186:0:19022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788263551.968187:0:19022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788263551.968188:0:19022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788263551.968189:0:19022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788263551.968191:0:19022:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788263551.968192:0:19022:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788263551.968194:0:19022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788263551.968195:0:19022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788263551.968210:0:19022:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788263551.974917:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263551.975096:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788263551.975473:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263551.976013:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788263551.976384:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263551.976541:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788263551.977542:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263551.977909:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788263551.978177:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263551.978439:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788263551.978911:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263551.979077:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788263552.003441:0:19022:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:2.0:1788263552.004099:0:19022:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788263552.004410:0:19080:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788263552.004475:0:19080:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788263552.007303:0:19022:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788263552.007425:0:19022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1788263552.007928:0:19079:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:0.0:1788263552.007933:0:19079:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000004:00000080:1.0:1788263552.009347:0:19022:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788263552.009367:0:19022:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788263552.009623:0:19022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263552.010151:0:19080:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788263552.010247:0:19080:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788263552.010251:0:19080:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1788263552.012130:0:19022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788263552.012898:0:19022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788263552.012943:0:19022:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788263552.013905:0:19022:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1788263552.015466:0:19022:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:0.0:1788263552.021508:0:19022:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788263552.047340:0:19022:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788263552.047377:0:19022:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb13201c3f988 00100000:10000000:1.0:1788263552.047385:0:19022:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788263552.048318:0:19022:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788263552.048339:0:19022:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788263552.048357:0:19022:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788263552.048381:0:19022:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788263552.712640:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263552.961176:0:19070:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788263552.961185:0:19070:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788263552.961873:0:19070:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788263552.961880:0:19070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:3.0:1788263553.468102:0:19037:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788263553.468110:0:19037:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99437fb8c000 from 9 10000000:01000000:3.0:1788263553.468115:0:19037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788263553.468161:0:19037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263553.468174:0:19037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263553.468186:0:19037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263553.468212:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753783424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263553.468309:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263553.468353:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcc5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263553.468423:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753783424 00000100:00100000:0.0:1788263553.468431:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753783424 00000100:00100000:0.0:1788263553.468479:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788263553.468489:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19037:x1875129753783424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263553.468502:0:19033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263553.468515:0:19033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d800/0x1a657bc51395731d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513957316 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263553.468537:0:19033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d800/0x1a657bc51395731d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513957316 expref: 12 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263553.468548:0:19033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d800/0x1a657bc51395731d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513957316 expref: 12 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263553.468557:0:19033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d800, rc 0) 00000100:00100000:0.0:1788263553.468592:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19037:x1875129753783424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263553.468599:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788263553.468802:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753783424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263553.468817:0:19037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263553.468836:0:19037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263553.468886:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753783552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788263553.468916:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263553.468947:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcc5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263553.469002:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753783552 00000100:00100000:0.0:1788263553.469006:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753783552 00000100:00100000:0.0:1788263553.469036:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788263553.469044:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19037:x1875129753783552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788263553.469058:0:19034:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788263553.469074:0:19034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788263553.469077:0:19034:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788263553.469141:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19037:x1875129753783552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263553.469155:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788263553.469248:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753783552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788263553.469285:0:19037:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788263553.469292:0:19037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263553.469302:0:19037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263553.724920:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788263553.980344:0:19070:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788263553.980353:0:19070:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263553.980775:0:19070:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788263553.980837:0:19070:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263553.980876:0:19070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1788263554.750757:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263555.775371:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263556.798772:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788263557.372450:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263557.372457:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263557.372460:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788263557.372463:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788263557.372465:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788263557.372469:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788263557.372472:0:8:0:(import.c:65:import_set_state_nolock()) ffff99438144f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788263557.372484:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99438144f000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788263557.372505:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9943755bca80 x1875129753783808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263557.372570:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753783808:0@lo:38:kworker.0 00000100:00100000:3.0:1788263557.372637:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263557.372860:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263557.372872:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3320:1875129753783680:0@lo:400:kworker.0 00000100:00100000:2.0:1788263557.372910:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263557.373614:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753783808 00000100:00100000:1.0:1788263557.373625:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753783808 00000100:00100000:1.0:1788263557.373672:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263557.373680:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3319:x1875129753783808:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788263557.373706:0:19042:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:1.0:1788263557.373741:0:19042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x1a657bc513957324 00000004:00100000:1.0:1788263557.373756:0:19042:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788263557.373918:0:19042:0:(import.c:65:import_set_state_nolock()) ffff9943472d6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788263557.373981:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875129753783808:12345-0@lo:38:kworker.0 Request processed in 299us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263557.373988:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263557.376605:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753783680 00000100:00100000:3.0:1788263557.376618:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753783680 00000100:00100000:3.0:1788263557.376684:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788263557.376695:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:3320:x1875129753783680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263557.376781:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:3320:x1875129753783680:12345-0@lo:400:kworker.0 Request processed in 88us (3870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263557.376789:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788263557.376849:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9943755bca80 x1875129753783808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788263557.376872:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788263557.376882:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788263557.376890:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788263557.376893:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99438144f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788263557.376900:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875129753783808:0@lo:38:kworker.0 00000100:00100000:3.0:1788263557.376934:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3320:1875129753783680:0@lo:400:kworker.0 00000001:02000400:2.0:1788263557.529170:0:19325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788263557.820798:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263558.846437:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263559.868375:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263560.891484:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788263560.910173:0:19475:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb3cce400 20000000:00000080:0.0:1788263560.910194:0:19475:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994380622800 uarg=0000000000000000 20000000:01000000:0.0:1788263560.910306:0:19475:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788263560.910313:0:19475:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788263560.910318:0:19475:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788263560.911097:0:19476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788263560.911712:0:19475:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788263560.918911:0:19475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788263560.919037:0:19475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263560.919075:0:19475:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994380658800/0x1a657bc5139572ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139572e5 expref: 11 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263560.919083:0:19475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263560.919132:0:19475:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994380658800/0x1a657bc5139572ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc5139572e5 expref: 11 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263560.919149:0:19475:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994380658800/0x1a657bc5139572ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc5139572e5 expref: 11 pid: 19034 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263560.919165:0:19475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19475:1875129753783936:0@lo:104: 00000100:00100000:1.0:1788263560.919875:0:19475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263560.919965:0:19475:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcc56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263560.920027:0:19024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753783936 00000100:00100000:2.0:1788263560.920036:0:19024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753783936 00000100:00100000:2.0:1788263560.920130:0:19024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263560.920141:0:19024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+3:19475:x1875129753783936:12345-0@lo:104: 00010000:00010000:2.0:1788263560.920154:0:19024:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263560.920259:0:19024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263560.920266:0:19024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+3:19475:x1875129753783936:12345-0@lo:104: Request processed in 128us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263560.920272:0:19024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788263560.920440:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263560.920446:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920454:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159e00 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263560.920458:0:19029:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920466:0:19029:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263560.920474:0:19029:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263560.920508:0:19029:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788263560.920541:0:19029:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920548:0:19029:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263560.920571:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920577:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343159e00/0x1a657bc5139572e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139572ec expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920600:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263560.920602:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263560.920603:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263560.920660:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3322:1875129753784064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263560.920695:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263560.920757:0:19026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753784064 00000100:00100000:0.0:1788263560.920762:0:19026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753784064 00010000:00010000:0.0:1788263560.920783:0:19026:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994380658800/0x1a657bc5139572ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139572e5 expref: 12 pid: 19034 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263560.920806:0:19026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263560.920814:0:19026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:3322:x1875129753784064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263560.920824:0:19026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263560.920830:0:19026:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994380658800/0x1a657bc5139572ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139572e5 expref: 12 pid: 19034 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920840:0:19026:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994380658800/0x1a657bc5139572ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc5139572e5 expref: 12 pid: 19034 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920863:0:19026:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920871:0:19026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920884:0:19026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920891:0:19026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920898:0:19026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920904:0:19026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920908:0:19026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242898a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263560.920912:0:19026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920918:0:19026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920926:0:19026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263560.920934:0:19026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263560.920964:0:19026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:3322:x1875129753784064:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263560.920979:0:19026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263560.921013:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3322:1875129753784064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263560.921257:0:19475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994380658800/0x1a657bc5139572ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc5139572e5 expref: 11 pid: 19034 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263560.921268:0:19475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19475:1875129753783936:0@lo:104: 00010000:00010000:1.0:1788263560.921281:0:19475:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263560.921289:0:19475:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263560.921294:0:19475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263560.921299:0:19475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994242898a00/0x1a657bc51395732b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263561.467523:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263551/real 1788263551] req@ffff994379f24000 x1875129753781120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263561 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263561.467556:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994379f24000 x1875129753781120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263561 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263561.467567:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263551/real 1788263551] req@ffff994381189880 x1875129753780992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263561 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263561.467610:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994381189880 x1875129753780992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263561 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788263561.467630:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994375e65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263561.467663:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788263561.467667:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753781120:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788263561.467673:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437f52b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788263561.467678:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788263561.467680:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753780992:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788263561.467807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263561.467812:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788263561.467814:0:8:0:(import.c:65:import_set_state_nolock()) ffff99437f52b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788263561.467819:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 578 00000100:00080000:0.0:1788263561.467823:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788263561.467830:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99437f52b800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788263561.467850:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994381188380 x1875129753784320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788263561.467866:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263561.467869:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788263561.467870:0:8:0:(import.c:65:import_set_state_nolock()) ffff994375e65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788263561.467873:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 578 00000100:00080000:0.0:1788263561.467875:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788263561.467878:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994375e65800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788263561.467890:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994381189180 x1875129753784448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788263561.467932:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753784576:0@lo:400:kworker.0 00000100:00100000:0.0:1788263561.468000:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263561.468081:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753784576 00000100:00100000:0.0:1788263561.468088:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753784576 00000100:00100000:0.0:1788263561.468132:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263561.468155:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753784576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263561.468244:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753784576:12345-0@lo:400:kworker.0 Request processed in 63us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263561.468252:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788263561.468289:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99438118b100 x1875129753784576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263561.468301:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753784576:0@lo:400:kworker.0 00000100:00100000:0.0:1788263561.468317:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753784320:0@lo:8:kworker.0 00000400:00000100:0.0:1788263561.468354:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129753784320 offset 0 length 520: 4 00000100:00100000:0.0:1788263561.468374:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753784448:0@lo:8:kworker.0 00000400:00000100:0.0:1788263561.468389:0:3319:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875129753784448 offset 0 length 520: 4 00000100:00100000:2.0:1788263561.468533:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3323:1875129753784192:0@lo:400:kworker.0 00000100:00100000:2.0:1788263561.468567:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263561.470545:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753784192 00000100:00100000:0.0:1788263561.470561:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753784192 00000100:00100000:0.0:1788263561.470641:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788263561.470652:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:3323:x1875129753784192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263561.470746:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:3323:x1875129753784192:12345-0@lo:400:kworker.0 Request processed in 96us (2177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263561.470753:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788263561.470899:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3323:1875129753784192:0@lo:400:kworker.0 00010000:00010000:3.0:1788263561.915598:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788263562.811297:0:19037:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788263562.811304:0:19037:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99437fb8c000 from 10 10000000:01000000:0.0:1788263562.811307:0:19037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788263562.811343:0:19037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263562.811351:0:19037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263562.811368:0:19037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263562.811387:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753784704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788263562.811442:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263562.811492:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375e8acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263562.811567:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753784704 00000100:00100000:3.0:1788263562.811575:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753784704 00000100:00100000:3.0:1788263562.811637:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788263562.811647:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+11:19037:x1875129753784704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263562.811660:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263562.811674:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343158a00/0x1a657bc513957339 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513957332 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263562.811697:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343158a00/0x1a657bc513957339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513957332 expref: 12 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263562.811707:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343158a00/0x1a657bc513957339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513957332 expref: 12 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263562.811717:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158a00, rc 0) 00000100:00100000:3.0:1788263562.811776:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19037:x1875129753784704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263562.811784:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788263562.812101:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753784704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263562.812116:0:19037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263562.812125:0:19037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263562.812177:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753784832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263562.812205:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263562.812250:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcc50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263562.812300:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753784832 00000100:00100000:0.0:1788263562.812305:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753784832 00000100:00100000:0.0:1788263562.812336:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788263562.812344:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19037:x1875129753784832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788263562.812577:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19037:x1875129753784832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263562.812584:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788263562.812706:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753784832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263562.812733:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753784960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263562.812768:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263562.812789:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bcc50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263562.812838:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753784960 00000100:00100000:3.0:1788263562.812843:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753784960 00000100:00100000:3.0:1788263562.812872:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788263562.812880:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380185050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19037:x1875129753784960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263562.813189:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380185050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19037:x1875129753784960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 309us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263562.813196:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788263562.813358:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753784960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788263562.815377:0:19544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788263562.815766:0:19037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788263562.815785:0:19037:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788263562.815795:0:19037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263562.815806:0:19037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263562.941944:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788263563.198117:0:19070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788263563.968580:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263564.988415:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263566.021843:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788263566.179583:0:19725:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263566.179587:0:19725:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788263566.179703:0:19725:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99437a562800 00000020:01000004:2.0:1788263566.179719:0:19725:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788263566.179733:0:19725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788263566.179749:0:19725:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99424387cd28) 00000020:00000080:2.0:1788263566.179767:0:19725:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788263566.205314:0:19725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788263566.206147:0:19725:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788263566.209259:0:19725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788263566.210314:0:19725:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788263566.211211:0:19725:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:3.0:1788263566.212174:0:19725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 209: rc = 0 00100000:10000000:3.0:1788263566.212334:0:19725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 209: rc = 0 00100000:10000000:3.0:1788263566.212795:0:19725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 209: rc = 0 00100000:10000000:3.0:1788263566.214333:0:19725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788263566.216004:0:19725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 451: rc = 0 00100000:10000000:3.0:1788263566.216300:0:19725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 451: rc = 0 00100000:10000000:3.0:1788263566.218257:0:19725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 451: rc = 0 00100000:10000000:3.0:1788263566.218596:0:19725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 451: rc = 0 00100000:10000000:3.0:1788263566.219509:0:19725:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 451: rc = 0 00000020:00000080:3.0:1788263566.223181:0:19725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788263566.223194:0:19725:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788263566.223205:0:19725:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1a657bc513957347 00000020:01000004:3.0:1788263566.223214:0:19725:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788263566.223367:0:19725:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788263566.223371:0:19725:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788263566.223378:0:19725:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788263566.223382:0:19725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788263566.223393:0:19725:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9942421b0000) 00000020:00000080:3.0:1788263566.223725:0:19725:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788263566.225167:0:19725:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263566.225375:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788263566.225381:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788263566.227014:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788263566.227024:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788263566.227359:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788263566.227369:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788263566.235927:0:19725:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788263566.236105:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788263566.236112:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788263566.249149:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788263566.249162:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788263566.279825:0:19725:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263566.280071:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788263566.280078:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788263566.284200:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788263566.284245:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788263566.287573:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788263566.287590:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788263566.291160:0:19725:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263566.291385:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788263566.291392:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788263566.292085:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788263566.292092:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788263566.320997:0:19725:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788263566.321191:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788263566.321197:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788263566.331543:0:19725:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788263566.331559:0:19725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788263566.332856:0:19725:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788263566.332883:0:19725:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788263566.332890:0:19725:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788263566.342621:0:19725:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788263566.342652:0:19725:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788263566.342656:0:19725:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788263566.342657:0:19725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263566.342658:0:19725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263566.342659:0:19725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263566.342660:0:19725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263566.342660:0:19725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263566.342664:0:19725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263566.342666:0:19725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263566.342667:0:19725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788263566.342669:0:19725:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788263566.342671:0:19725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788263566.342672:0:19725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263566.342672:0:19725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263566.342673:0:19725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263566.342673:0:19725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263566.342674:0:19725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263566.342675:0:19725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263566.342675:0:19725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263566.342676:0:19725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788263566.342699:0:19725:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788263566.342714:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788263566.342771:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.342852:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943450cc240 going to sleep for 11 seconds 00000100:00100000:1.0:1788263566.342888:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753785088 00000100:00100000:1.0:1788263566.342895:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753785088 00000100:00100000:1.0:1788263566.342955:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788263566.342963:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380185c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19725:x1875129753785088:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788263566.342992:0:19034:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788263566.342994:0:19034:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788263566.342997:0:19034:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788263566.354066:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380185c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19725:x1875129753785088:12345-0@lo:253:mount.lustre.0 Request processed in 11094us (11285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263566.354094:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788263566.354274:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785088:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788263566.354293:0:19725:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788263566.354298:0:19725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788263566.354299:0:19725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263566.354300:0:19725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263566.354302:0:19725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263566.354303:0:19725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263566.354304:0:19725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263566.354306:0:19725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263566.354308:0:19725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263566.354309:0:19725:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788263566.354329:0:19725:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99437a562800 from lustre-OST0000 10000000:01000000:3.0:1788263566.354358:0:19725:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788263566.354361:0:19725:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788263566.354368:0:19725:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff994346b319b8 local copy 00010000:00010000:3.0:1788263566.354379:0:19725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957244 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263566.354717:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263566.354758:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.354831:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff99436dcdb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788263566.354875:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753785216 00000100:00100000:0.0:1788263566.354882:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753785216 00000100:00100000:0.0:1788263566.354952:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788263566.354963:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380186450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19725:x1875129753785216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263566.355255:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380186450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19725:x1875129753785216:12345-0@lo:501:mount.lustre.0 Request processed in 294us (495us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788263566.355262:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788263566.355425:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785216:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788263566.355439:0:19725:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788263566.355598:0:19725:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788263566.355606:0:19725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957244 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263566.355615:0:19725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957244 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263566.355640:0:19725:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99437a562800 10000000:01000000:1.0:1788263566.355645:0:19725:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788263566.355649:0:19725:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff994346b319b8 10000000:01000000:1.0:1788263566.355652:0:19725:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788263566.355655:0:19725:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff994346b319b8 from 1 10000000:01000000:1.0:1788263566.355659:0:19725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788263566.355685:0:19725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994242898c00/0x1a657bc513957355 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263566.355692:0:19725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994242898c00/0x1a657bc513957355 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263566.355701:0:19725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994242898c00/0x1a657bc513957355 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263566.355721:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785344:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788263566.355747:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263566.357670:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943723306c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263566.358441:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753785344 00000100:00100000:0.0:1788263566.358450:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753785344 00000100:00100000:1.0:1788263566.358614:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788263566.358624:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+12:19725:x1875129753785344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263566.358640:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263566.358658:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242899400/0x1a657bc51395735c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513957355 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263566.358685:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242899400/0x1a657bc51395735c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513957355 expref: 13 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263566.358695:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242899400/0x1a657bc51395735c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513957355 expref: 13 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263566.358704:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899400, rc 0) 00000100:00100000:1.0:1788263566.358808:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+13:19725:x1875129753785344:12345-0@lo:101:mount.lustre.0 Request processed in 185us (3059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263566.358814:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788263566.358891:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263566.358920:0:19725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994242898c00/0x1a657bc513957355 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395735c expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263566.358928:0:19725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994242898c00/0x1a657bc513957355 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc51395735c expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263566.358947:0:19725:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788263566.358963:0:19725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994242898c00/0x1a657bc513957355 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395735c expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263566.358969:0:19725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994242898c00/0x1a657bc513957355 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395735c expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263566.358976:0:19725:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788263566.358981:0:19725:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263566.358985:0:19725:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788263566.358988:0:19725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788263566.359009:0:19725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380659e00/0x1a657bc513957363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263566.359016:0:19725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994380659e00/0x1a657bc513957363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263566.359024:0:19725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994380659e00/0x1a657bc513957363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263566.359042:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263566.359073:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263566.359112:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff994342bee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263566.359171:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753785472 00000100:00100000:3.0:1788263566.359176:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753785472 00000100:00100000:3.0:1788263566.359208:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788263566.359214:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+13:19725:x1875129753785472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263566.359245:0:19033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263566.359253:0:19033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343158000/0x1a657bc51395736a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513957363 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.359267:0:19033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343158000/0x1a657bc51395736a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513957363 expref: 14 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.359275:0:19033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343158000/0x1a657bc51395736a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513957363 expref: 14 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.359282:0:19033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158000, rc 0) 00000100:00100000:3.0:1788263566.359309:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+14:19725:x1875129753785472:12345-0@lo:101:mount.lustre.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263566.359316:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788263566.359391:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263566.359401:0:19725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994380659e00/0x1a657bc513957363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395736a expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263566.359409:0:19725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994380659e00/0x1a657bc513957363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc51395736a expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788263566.360101:0:19725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788263566.360973:0:19725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263566.361210:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788263566.361823:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788263566.361856:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788263566.361904:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788263566.361938:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788263566.361968:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788263566.362010:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788263566.362045:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788263566.362161:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788263566.362209:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788263566.362411:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788263566.362460:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788263566.362534:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788263566.362541:0:19725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788263566.362624:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263566.362682:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263566.362759:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff994342bee6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263566.362799:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753785600 00000100:00100000:3.0:1788263566.362805:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753785600 00000100:00100000:3.0:1788263566.362877:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788263566.362886:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+14:19725:x1875129753785600:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263566.363214:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+14:19725:x1875129753785600:12345-0@lo:501:mount.lustre.0 Request processed in 328us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263566.363266:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788263566.363389:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263566.363423:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785728:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263566.363460:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263566.363637:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375e8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263566.363709:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753785728 00000100:00100000:2.0:1788263566.363714:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753785728 00000100:00100000:2.0:1788263566.363736:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788263566.363743:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+14:19725:x1875129753785728:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263566.364027:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+14:19725:x1875129753785728:12345-0@lo:503:mount.lustre.0 Request processed in 283us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263566.364035:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788263566.364160:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785728:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788263566.364856:0:19725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263566.364921:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263566.364962:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263566.364977:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375e8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263566.365198:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753785856 00000100:00100000:2.0:1788263566.365204:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753785856 00000100:00100000:2.0:1788263566.365242:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788263566.365250:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+14:19725:x1875129753785856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263566.365507:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+14:19725:x1875129753785856:12345-0@lo:502:mount.lustre.0 Request processed in 245us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263566.365515:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788263566.365696:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788263566.365902:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788263566.365946:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788263566.365980:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788263566.366024:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788263566.366059:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788263566.366170:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788263566.366491:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788263566.366548:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788263566.366581:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788263566.366629:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788263566.366664:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788263566.366708:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788263566.366742:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263566.366794:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263566.366881:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff994372330840 going to sleep for 11 seconds 00000100:00100000:2.0:1788263566.366925:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753785984 00000100:00100000:2.0:1788263566.366931:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753785984 00000100:00100000:2.0:1788263566.368150:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788263566.368166:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+14:19725:x1875129753785984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263566.368941:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+14:19725:x1875129753785984:12345-0@lo:502:mount.lustre.0 Request processed in 779us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263566.368949:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788263566.369283:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753785984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788263566.369384:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788263566.369397:0:19725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1788263566.370376:0:19739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788263566.370390:0:19739:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788263566.370396:0:19739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788263566.370398:0:19739:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788263566.370404:0:19739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788263566.370418:0:19739:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9943473ecd28) 00000020:00000080:0.0:1788263566.370438:0:19739:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788263566.370444:0:19739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788263566.370524:0:19739:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99437a562800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788263566.370531:0:19739:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788263566.370539:0:19739:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x1a657bc513957378 00010000:00010000:1.0:1788263566.373973:0:19739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788263566.374586:0:19739:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:1.0:1788263566.377004:0:19739:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788263566.378353:0:19739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788263566.378364:0:19739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263566.378370:0:19739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263566.378372:0:19739:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788263566.378375:0:19739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788263566.378377:0:19739:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788263566.378379:0:19739:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788263566.378381:0:19739:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788263566.378382:0:19739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788263566.378385:0:19739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263566.378386:0:19739:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788263566.378389:0:19739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263566.378392:0:19739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263566.378393:0:19739:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788263566.378396:0:19739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788263566.378398:0:19739:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788263566.378400:0:19739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263566.378402:0:19739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263566.378404:0:19739:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788263566.378406:0:19739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263566.378408:0:19739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263566.378410:0:19739:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788263566.378413:0:19739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788263566.378460:0:19739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263566.378464:0:19739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263566.378465:0:19739:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788263566.378475:0:19739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788263566.380900:0:19725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788263566.380951:0:19725:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788263566.380979:0:19725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380659e00/0x1a657bc513957363 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395736a expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.380993:0:19725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380659e00/0x1a657bc513957363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395736a expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263566.381001:0:19725:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99437a562800 from 1 10000000:01000000:3.0:1788263566.381004:0:19725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263566.381040:0:19725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.381047:0:19725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.381058:0:19725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263566.381092:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263566.381171:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.381210:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468f2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263566.381622:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753786112 00000100:00100000:1.0:1788263566.381630:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753786112 00000100:00100000:1.0:1788263566.381668:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788263566.381677:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+14:19725:x1875129753786112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263566.381689:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263566.381702:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242898800/0x1a657bc513957386 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395737f expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263566.381724:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242898800/0x1a657bc513957386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395737f expref: 15 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263566.381735:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242898800/0x1a657bc513957386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395737f expref: 15 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263566.381744:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242898800, rc 0) 00000100:00100000:1.0:1788263566.381782:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19725:x1875129753786112:12345-0@lo:101:mount.lustre.0 Request processed in 106us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263566.381790:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788263566.384406:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263566.384433:0:19725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.384445:0:19725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263566.384967:0:19725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:3.0:1788263566.385303:0:19725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263566.385540:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788263566.385581:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788263566.385624:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788263566.385656:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788263566.385685:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788263566.385726:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788263566.385757:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788263566.385785:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788263566.385843:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788263566.385851:0:19725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:3.0:1788263566.385918:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263566.385979:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.386016:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468f2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263566.386116:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753786240 00000100:00100000:2.0:1788263566.386122:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753786240 00000100:00100000:2.0:1788263566.386167:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788263566.386176:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19725:x1875129753786240:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263566.386384:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19725:x1875129753786240:12345-0@lo:501:mount.lustre.0 Request processed in 208us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263566.386392:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788263566.388014:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263566.388066:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263566.388188:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.388292:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468f2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788263566.392415:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753786368 00000100:00100000:0.0:1788263566.392431:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753786368 00000100:00100000:0.0:1788263566.392507:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788263566.392519:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19725:x1875129753786368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263566.392759:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19725:x1875129753786368:12345-0@lo:503:mount.lustre.0 Request processed in 242us (4569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263566.392766:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788263566.392886:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788263566.393391:0:19725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788263566.393469:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263566.393523:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.393557:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349694f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263566.393695:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753786496 00000100:00100000:0.0:1788263566.393700:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753786496 00000100:00100000:0.0:1788263566.393722:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788263566.393729:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19725:x1875129753786496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263566.393852:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19725:x1875129753786496:12345-0@lo:502:mount.lustre.0 Request processed in 122us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263566.393858:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788263566.393998:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263566.394337:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788263566.394388:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788263566.394437:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788263566.394489:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788263566.394546:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788263566.394595:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788263566.394629:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788263566.394663:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788263566.394689:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263566.394727:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.394800:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349694f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263566.395674:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753786624 00000100:00100000:0.0:1788263566.395683:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753786624 00000100:00100000:1.0:1788263566.395872:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788263566.395882:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19725:x1875129753786624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263566.396079:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19725:x1875129753786624:12345-0@lo:502:mount.lustre.0 Request processed in 188us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263566.396087:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788263566.396169:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263566.396301:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788263566.396313:0:19725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788263566.398099:0:19743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263566.398111:0:19743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263566.398113:0:19743:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788263566.398120:0:19743:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99437a562800 00000020:00000080:3.0:1788263566.398122:0:19743:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263566.398129:0:19743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263566.398131:0:19743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263566.398132:0:19743:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788263566.398135:0:19743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263566.398137:0:19743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263566.398138:0:19743:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788263566.398141:0:19743:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99437a562800 00000020:00000080:3.0:1788263566.398142:0:19743:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263566.398194:0:19743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263566.398198:0:19743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263566.398199:0:19743:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788263566.398202:0:19743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263566.398204:0:19743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263566.398205:0:19743:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788263566.398208:0:19743:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99437a562800 00000020:00000080:3.0:1788263566.398210:0:19743:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263566.398275:0:19743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263566.398278:0:19743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263566.398280:0:19743:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788263566.398282:0:19743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:3.0:1788263566.398368:0:19725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788263566.398386:0:19725:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263566.398399:0:19725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.398409:0:19725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263566.398445:0:19725:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788263566.398448:0:19725:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99437a562800 10000000:01000000:3.0:1788263566.398451:0:19725:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99437a562800 10000000:01000000:3.0:1788263566.398454:0:19725:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788263566.398459:0:19725:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99437a562800 from 1 10000000:01000000:3.0:1788263566.398461:0:19725:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788263566.398490:0:19725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc51395738d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.398509:0:19725:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc51395738d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.398519:0:19725:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc51395738d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263566.398541:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263566.398591:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.402528:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943496943c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263566.405339:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753786752 00000100:00100000:0.0:1788263566.405352:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753786752 00000100:00100000:0.0:1788263566.405415:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788263566.405425:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19725:x1875129753786752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263566.405452:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263566.405470:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d200/0x1a657bc513957394 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395738d expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.405516:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d200/0x1a657bc513957394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395738d expref: 16 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.405528:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d200/0x1a657bc513957394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395738d expref: 16 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.405538:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d200, rc 0) 00000100:00100000:0.0:1788263566.405614:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19725:x1875129753786752:12345-0@lo:101:mount.lustre.0 Request processed in 191us (7023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263566.405622:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788263566.407374:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263566.407406:0:19725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc51395738d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957394 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.407416:0:19725:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc51395738d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513957394 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263566.409094:0:19725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1788263566.409478:0:19725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263566.409725:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788263566.409765:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788263566.409793:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788263566.409832:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788263566.409862:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788263566.409901:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788263566.409931:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788263566.409972:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788263566.410011:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788263566.410042:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788263566.410073:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788263566.410118:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788263566.410153:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788263566.410183:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788263566.410251:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788263566.410288:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788263566.410322:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788263566.410367:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788263566.410400:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788263566.410429:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788263566.410475:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788263566.410523:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788263566.410560:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788263566.410622:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788263566.410666:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1788263566.410700:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1788263566.410743:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1788263566.410775:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1788263566.410806:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1788263566.410859:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1788263566.410896:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1788263566.410930:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1788263566.410965:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1788263566.411010:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1788263566.411045:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1788263566.411086:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1788263566.411117:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1788263566.411146:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1788263566.411187:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1788263566.411258:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1788263566.411346:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1788263566.411353:0:19725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1788263566.411447:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263566.419686:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.419742:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943450cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788263566.419795:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753786880 00000100:00100000:0.0:1788263566.419803:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753786880 00000100:00100000:0.0:1788263566.419858:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788263566.419867:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19725:x1875129753786880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263566.420131:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19725:x1875129753786880:12345-0@lo:501:mount.lustre.0 Request processed in 264us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263566.420140:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788263566.420249:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753786880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263566.420294:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753787008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788263566.420336:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.420357:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943450cc240 going to sleep for 11 seconds 00000100:00100000:2.0:1788263566.420446:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753787008 00000100:00100000:2.0:1788263566.420450:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753787008 00000100:00100000:2.0:1788263566.420530:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788263566.420538:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19725:x1875129753787008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263566.420686:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19725:x1875129753787008:12345-0@lo:503:mount.lustre.0 Request processed in 149us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263566.420693:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788263566.420754:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753787008:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788263566.421245:0:19725:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788263566.421304:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753787136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263566.421348:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.425055:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943450cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788263566.425244:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753787136 00000100:00100000:0.0:1788263566.425253:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753787136 00000100:00100000:0.0:1788263566.425319:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788263566.425330:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19725:x1875129753787136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263566.425618:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19725:x1875129753787136:12345-0@lo:502:mount.lustre.0 Request processed in 290us (4269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263566.425635:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788263566.426041:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753787136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263566.426316:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788263566.426372:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788263566.426403:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788263566.426444:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788263566.426479:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788263566.426544:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788263566.426579:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788263566.426613:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788263566.426661:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788263566.426696:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788263566.426723:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788263566.426789:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788263566.426821:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788263566.426847:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788263566.426885:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788263566.426913:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788263566.426939:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788263566.426976:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788263566.427005:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788263566.427032:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788263566.427070:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788263566.427105:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788263566.427139:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788263566.427182:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788263566.427238:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1788263566.427275:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1788263566.427324:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1788263566.427372:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1788263566.427415:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1788263566.427456:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1788263566.427488:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1788263566.427535:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1788263566.427566:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1788263566.427607:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1788263566.427639:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1788263566.427679:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1788263566.427711:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1788263566.427742:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1788263566.427788:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1788263566.427822:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1788263566.427865:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753787264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263566.427932:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.427955:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943450cc240 going to sleep for 11 seconds 00000100:00100000:1.0:1788263566.428064:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753787264 00000100:00100000:1.0:1788263566.428072:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753787264 00000100:00100000:1.0:1788263566.428113:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788263566.428122:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19725:x1875129753787264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263566.428366:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19725:x1875129753787264:12345-0@lo:502:mount.lustre.0 Request processed in 244us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263566.428374:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788263566.428546:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753787264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263566.428615:0:19725:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1788263566.428625:0:19725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788263566.430598:0:19748:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788263566.430617:0:19748:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9942421b4d28) 00000020:00000080:3.0:1788263566.430642:0:19748:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788263566.430724:0:19748:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99437a562800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788263566.430729:0:19748:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99437a562800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788263566.430732:0:19748:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99437a562800 3 00010000:00080000:3.0:1788263566.430763:0:19748:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99438144b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.129@tcp at head 00010000:00010000:3.0:1788263566.433151:0:19748:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788263566.433682:0:19748:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788263566.433720:0:19748:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788263566.433730:0:19748:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x1a657bc5139573a2 00000100:00080000:3.0:1788263566.433740:0:19748:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788263566.433751:0:19748:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99438144b000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788263566.433786:0:19748:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9943755bca80 x1875129753787392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263566.433810:0:19748:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788263566.433889:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263566.433893:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263566.433897:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263566.433899:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788263566.434445:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1875129753787392:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788263566.434526:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263566.434701:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753787520:0@lo:400:kworker.0 00000100:00100000:0.0:1788263566.434727:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263566.434765:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753787392 00000100:00100000:0.0:1788263566.434772:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753787392 00000100:00100000:0.0:1788263566.434797:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753787520 00000100:00100000:0.0:1788263566.434799:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753787520 00000100:00100000:0.0:1788263566.434820:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263566.434828:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753787520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263566.434873:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753787520:12345-0@lo:400:kworker.0 Request processed in 45us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263566.434879:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263566.434893:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263566.434897:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3319:x1875129753787392:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788263566.434916:0:19041:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 593 last 0 00000020:00000080:0.0:1788263566.434958:0:19041:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x1a657bc5139573a9 00000004:00100000:0.0:1788263566.434972:0:19041:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788263566.434999:0:19041:0:(import.c:65:import_set_state_nolock()) ffff99434659f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263566.435032:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875129753787392:12345-0@lo:38:llog_process_th.0 Request processed in 134us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263566.435038:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788263566.435071:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff994379f25880 x1875129753787520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263566.435095:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753787520:0@lo:400:kworker.0 00010000:00080000:0.0:1788263566.435124:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9943755bca80 x1875129753787392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263566.435131:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788263566.435136:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788263566.435142:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788263566.435145:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788263566.435147:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99438144b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788263566.435152:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1875129753787392:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788263566.435456:0:19748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:3.0:1788263566.435522:0:19725:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788263566.435546:0:19725:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788263566.435566:0:19725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc51395738d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957394 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263566.435578:0:19725:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343159a00/0x1a657bc51395738d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957394 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788263566.435620:0:19725:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788263566.435623:0:19725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263566.435624:0:19725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263566.435625:0:19725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263566.435626:0:19725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263566.435628:0:19725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263566.435630:0:19725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263566.435631:0:19725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263566.435633:0:19725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788263566.435637:0:19725:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788263566.435639:0:19725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788263566.435641:0:19725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263566.435642:0:19725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263566.435643:0:19725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263566.435644:0:19725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263566.435645:0:19725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263566.435646:0:19725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263566.435647:0:19725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263566.435648:0:19725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788263566.435666:0:19725:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788263566.435678:0:19725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753787648:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788263566.435731:0:19725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263566.435751:0:19725:0:(client.c:2715:ptlrpc_set_wait()) set ffff994356548cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788263566.436402:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753787648 00000100:00100000:1.0:1788263566.436409:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753787648 00000100:00100000:1.0:1788263566.436454:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788263566.436463:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19725:x1875129753787648:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788263566.436488:0:19035:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788263566.436512:0:19035:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788263566.463785:0:19035:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788263566.463807:0:19035:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788263566.464131:0:19056:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788263566.464137:0:19056:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788263566.464159:0:19056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.464178:0:19056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216d800/0x1a657bc51395731d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513957316 expref: 16 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.464187:0:19056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.464261:0:19056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216d800/0x1a657bc51395731d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513957316 expref: 16 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.464276:0:19056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99438216d800/0x1a657bc51395731d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513957316 expref: 16 pid: 19033 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263566.464290:0:19056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19056:1875129753787776:0@lo:104: 00000100:00100000:0.0:1788263566.464364:0:19056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263566.464412:0:19056:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943454a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788263566.464437:0:19023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753787776 00000100:00100000:0.0:1788263566.464443:0:19023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753787776 00000100:00100000:0.0:1788263566.464481:0:19023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263566.464489:0:19023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+3:19056:x1875129753787776:12345-0@lo:104: 00010000:00010000:0.0:1788263566.464513:0:19023:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.464558:0:19023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788263566.464564:0:19023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+3:19056:x1875129753787776:12345-0@lo:104: Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263566.464570:0:19023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788263566.464590:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263566.464596:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.464603:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159200 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:0.0:1788263566.464607:0:19029:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.464615:0:19029:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788263566.464622:0:19029:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788263566.464627:0:19029:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788263566.464654:0:19029:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.464669:0:19029:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788263566.464688:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.464694:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343159200/0x1a657bc513957316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc51395731d expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.464709:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263566.464710:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263566.464712:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263566.464733:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3322:1875129753787904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788263566.464758:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263566.464816:0:19056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19056:1875129753787776:0@lo:104: 00010000:00010000:0.0:1788263566.464834:0:19056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263566.465587:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753787904 00000100:00100000:0.0:1788263566.465594:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753787904 00010000:00010000:0.0:1788263566.465614:0:19027:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216d800/0x1a657bc51395731d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513957316 expref: 17 pid: 19033 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263566.465637:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263566.465644:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:3322:x1875129753787904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263566.465654:0:19027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263566.465660:0:19027:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216d800/0x1a657bc51395731d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513957316 expref: 17 pid: 19033 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465670:0:19027:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216d800/0x1a657bc51395731d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513957316 expref: 17 pid: 19033 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465704:0:19027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216d800/0x1a657bc51395731d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513957316 expref: 17 pid: 19033 timeout: 693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465719:0:19027:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465726:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788263566.465737:0:19027:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001601398s 00010000:00010000:0.0:1788263566.465742:0:19027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465749:0:19027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465756:0:19027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465762:0:19027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465767:0:19027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263566.465770:0:19027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465777:0:19027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465788:0:19027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465802:0:19027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263566.465834:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:3322:x1875129753787904:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263566.465841:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263566.465945:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3322:1875129753787904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788263566.465964:0:19056:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465971:0:19056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263566.465977:0:19056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216ce00/0x1a657bc5139573b0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263566.474661:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19725:x1875129753787648:12345-0@lo:253:mount.lustre.0 Request processed in 38189us (38919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263566.474677:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788263566.474764:0:19725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19725:1875129753787648:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788263566.474780:0:19725:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788263566.474783:0:19725:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788263566.474784:0:19725:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788263566.474786:0:19725:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263566.474787:0:19725:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263566.474788:0:19725:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263566.474789:0:19725:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263566.474790:0:19725:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263566.474793:0:19725:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263566.474794:0:19725:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788263566.474810:0:19725:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788263566.475195:0:19725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263566.475521:0:19725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788263566.475676:0:19725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788263566.475821:0:19725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788263566.476191:0:19725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788263566.476648:0:19725:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788263566.477456:0:19725:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788263566.515332:0:19725:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788263566.515341:0:19725:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788263566.515379:0:19725:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788263566.515512:0:19725:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788263566.515527:0:19725:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788263566.515556:0:19725:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788263567.036375:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788263567.493068:0:19037:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788263567.493077:0:19037:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99437fb8c000 from 10 10000000:01000000:3.0:1788263567.493084:0:19037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788263567.493135:0:19037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263567.493149:0:19037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263567.493176:0:19037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263567.493205:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753788032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263567.493306:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263567.493355:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f2af600 going to sleep for 11 seconds 00000100:00100000:1.0:1788263567.502169:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753788032 00000100:00100000:1.0:1788263567.502183:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753788032 00000100:00100000:1.0:1788263567.502300:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788263567.502311:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+15:19037:x1875129753788032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263567.502330:0:19033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263567.502351:0:19033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242899c00/0x1a657bc5139573be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139573b7 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263567.502391:0:19033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242899c00/0x1a657bc5139573be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139573b7 expref: 16 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263567.502401:0:19033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242899c00/0x1a657bc5139573be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139573b7 expref: 16 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263567.502410:0:19033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899c00, rc 0) 00000100:00100000:1.0:1788263567.502498:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19037:x1875129753788032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (9193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263567.502505:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788263567.503412:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753788032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263567.503435:0:19037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263567.503445:0:19037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263567.503526:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753788160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788263567.503567:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263567.503609:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434f2af600 going to sleep for 11 seconds 00000100:00100000:1.0:1788263567.503736:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753788160 00000100:00100000:1.0:1788263567.503748:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753788160 00000100:00100000:1.0:1788263567.503789:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788263567.503796:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19037:x1875129753788160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788263567.503823:0:19035:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788263567.503838:0:19035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788263567.503841:0:19035:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788263567.503907:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19037:x1875129753788160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263567.503914:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788263567.504096:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753788160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788263567.504148:0:19037:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788263567.504154:0:19037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263567.504162:0:19037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263568.061279:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263569.084693:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263570.109824:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263571.133670:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788263571.719416:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263571.719424:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788263571.719427:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263571.719431:0:492:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788263571.719740:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3323:1875129753788288:0@lo:400:kworker.0 00000100:00100000:0.0:1788263571.719826:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263571.719899:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753788416:0@lo:400:kworker.0 00000100:00100000:0.0:1788263571.719929:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263571.719967:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753788288 00000100:00100000:0.0:1788263571.719975:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753788288 00000100:00100000:0.0:1788263571.720024:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263571.720034:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:3323:x1875129753788288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263571.720101:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:3323:x1875129753788288:12345-0@lo:400:kworker.0 Request processed in 68us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263571.720124:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788263571.720161:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753788416 00000100:00100000:0.0:1788263571.720165:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753788416 00000100:00100000:0.0:1788263571.720190:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263571.720197:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753788416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263571.720260:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753788416:12345-0@lo:400:kworker.0 Request processed in 63us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263571.720266:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263571.720308:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3323:1875129753788288:0@lo:400:kworker.0 00010000:00080000:0.0:1788263571.720354:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994379f25180 x1875129753788416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263571.720367:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753788416:0@lo:400:kworker.0 00000100:00100000:0.0:1788263571.721084:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753788544:0@lo:400:kworker.0 00000100:00100000:0.0:1788263571.721125:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263571.721166:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753788544 00000100:00100000:0.0:1788263571.721172:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753788544 00000100:00100000:0.0:1788263571.721233:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788263571.721243:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753788544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263571.721284:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753788544:12345-0@lo:400:kworker.0 Request processed in 43us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263571.721290:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788263571.721333:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994379f25c00 x1875129753788544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263571.721356:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753788544:0@lo:400:kworker.0 00000100:00080000:1.0:1788263571.722118:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788263572.155819:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263573.198837:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263573.276809:0:20091:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:2.0:1788263573.436909:0:19070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788263574.207065:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263575.229451:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.252400:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263576.700436:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263561/real 1788263561] req@ffff994381188380 x1875129753784320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263576 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263576.700479:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994381188380 x1875129753784320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263576 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263576.700491:0:3319:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788263561/real 1788263561] req@ffff994381189180 x1875129753784448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263576 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788263576.700502:0:3319:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff994381189180 x1875129753784448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788263576 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788263576.700525:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437f52b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263576.700540:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788263576.700544:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753784320:0@lo:8:kworker.0 00000100:00080000:0.0:1788263576.700550:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994375e65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788263576.700554:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788263576.700558:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753784448:0@lo:8:kworker.0 00000100:00080000:1.0:1788263576.700709:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263576.700715:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788263576.700718:0:492:0:(import.c:65:import_set_state_nolock()) ffff99437f52b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263576.700724:0:492:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:1.0:1788263576.700730:0:492:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788263576.700737:0:492:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99437f52b800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263576.700762:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994375bfbb80 x1875129753788800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788263576.700773:0:492:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788263576.700776:0:492:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788263576.700777:0:492:0:(import.c:65:import_set_state_nolock()) ffff994375e65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788263576.700781:0:492:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 588 00000100:00080000:1.0:1788263576.700783:0:492:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788263576.700786:0:492:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994375e65800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788263576.700795:0:492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994375bfb480 x1875129753788928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263576.700898:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753789056:0@lo:400:kworker.0 00000100:00100000:2.0:1788263576.700995:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263576.701070:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263576.701083:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3323:1875129753788672:0@lo:400:kworker.0 00000100:00100000:2.0:1788263576.701116:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263576.701155:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753788672 00000100:00100000:2.0:1788263576.701164:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753788672 00000100:00100000:2.0:1788263576.701214:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263576.701260:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:3323:x1875129753788672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263576.701330:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:3323:x1875129753788672:12345-0@lo:400:kworker.0 Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263576.701339:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788263576.701398:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3323:1875129753788672:0@lo:400:kworker.0 00000100:00100000:0.0:1788263576.701475:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753789184:0@lo:400:kworker.0 00000100:00100000:0.0:1788263576.701512:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263576.701564:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753788800:0@lo:8:kworker.0 00000100:00100000:0.0:1788263576.701593:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263576.701626:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753788928:0@lo:8:kworker.0 00000100:00100000:0.0:1788263576.701648:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263576.701988:0:19726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753788800 00000100:00100000:1.0:1788263576.701988:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753789056 00000100:00100000:1.0:1788263576.701995:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753789056 00000100:00100000:3.0:1788263576.701998:0:19726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753788800 00000100:00100000:3.0:1788263576.702021:0:19726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753788928 00000100:00100000:3.0:1788263576.702024:0:19726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753788928 00000100:00100000:1.0:1788263576.702024:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753789184 00000100:00100000:1.0:1788263576.702026:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753789184 00000100:00100000:3.0:1788263576.702035:0:19726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263576.702041:0:19726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3319:x1875129753788800:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788263576.702053:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263576.702059:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753789056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263576.702112:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753789056:12345-0@lo:400:kworker.0 Request processed in 53us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263576.702118:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788263576.702132:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263576.702137:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753789184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263576.702170:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753789184:12345-0@lo:400:kworker.0 Request processed in 33us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263576.702176:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788263576.702198:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788263576.702250:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994375bf8700 x1875129753789184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263576.702262:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753789184:0@lo:400:kworker.0 00010000:00080000:1.0:1788263576.702296:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994375bf8380 x1875129753789056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263576.702305:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753789056:0@lo:400:kworker.0 00010000:00080000:3.0:1788263576.705457:0:19726:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 603 last 0 00000020:00000080:3.0:1788263576.705510:0:19726:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc5139573c5 00002000:00100000:3.0:1788263576.705535:0:19726:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99434646a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788263576.705541:0:19726:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788263576.705545:0:19726:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788263576.711021:0:19726:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788263576.711088:0:19726:0:(import.c:65:import_set_state_nolock()) ffff99434646f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263576.712094:0:19726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1875129753788800:12345-0@lo:8:kworker.0 Request processed in 10044us (10491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263576.712110:0:19726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263576.712157:0:19726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788263576.712165:0:19726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3319:x1875129753788928:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788263576.712187:0:19726:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788263576.722754:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994375bfbb80 x1875129753788800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263576.722776:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788263576.722808:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788263576.722819:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788263576.722828:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788263576.722833:0:3319:0:(import.c:65:import_set_state_nolock()) ffff99437f52b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788263576.722877:0:3319:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788263576.722886:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753788800:0@lo:8:kworker.0 00000004:00080000:1.0:1788263576.726920:0:19062:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788263576.728534:0:19063:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:2.0:1788263576.728570:0:19063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19063:1875129753789440:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788263576.728686:0:19063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263576.728727:0:19063:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349afdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263576.728750:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753789312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263576.728777:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263576.728841:0:19727:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788263576.728850:0:19727:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788263576.728905:0:19730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753789312 00000100:00100000:2.0:1788263576.728915:0:19730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753789312 00000100:00100000:2.0:1788263576.729017:0:19730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788263576.729029:0:19730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753789312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263576.729080:0:19730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788263576.729144:0:19730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875129753789312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263576.729166:0:19730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788263576.729358:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994379f26300 x1875129753789312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263592 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788263576.729384:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753789312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263576.729432:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753789440 00000100:00100000:2.0:1788263576.729436:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753789440 00000100:00100000:2.0:1788263576.729531:0:20244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263576.729539:0:20244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:19063:x1875129753789440:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788263576.729917:0:19062:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 603517697222ns, next at 0ns, rc = 0 00000100:00080000:1.0:1788263576.730257:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788263576.734689:0:20244:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788263576.734705:0:20244:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788263576.734712:0:20244:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00000100:00100000:3.0:1788263576.752967:0:19726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3319:x1875129753788928:12345-0@lo:8:kworker.0 Request processed in 40790us (51307us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788263576.752985:0:19726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788263576.761053:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994375e65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788263576.761077:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788263576.761084:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753788928:0@lo:8:kworker.0 00002000:00010000:2.0:1788263576.766848:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.766866:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc5139573cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.766889:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.766895:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.766903:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc5139573cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.766927:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc5139573cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.766940:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc5139573cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.766949:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc5139573cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.766987:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263576.767005:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263576.767013:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc5139573cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.767023:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.767028:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc5139573cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.767038:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc5139573cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.767358:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc5139573cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.767368:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc5139573cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.767388:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.767391:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.767393:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.768021:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.768031:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc5139573d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768059:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.768069:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.768075:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc5139573d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768089:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc5139573d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768100:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc5139573d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768109:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc5139573d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768130:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263576.768144:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263576.768258:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc5139573d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768268:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.768272:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc5139573d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768281:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc5139573d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768296:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc5139573d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768329:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc5139573d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768346:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.768347:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.768350:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.768803:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.768811:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc5139573da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768821:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.768824:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.768828:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc5139573da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768838:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc5139573da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768846:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc5139573da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768854:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc5139573da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768871:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263576.768880:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263576.768889:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc5139573da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768896:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.768900:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc5139573da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768907:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc5139573da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768919:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc5139573da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768926:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc5139573da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.768938:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.768940:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.768942:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.769632:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.769642:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc5139573e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.769653:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.769656:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.769660:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc5139573e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.769681:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc5139573e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.769689:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc5139573e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.769696:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc5139573e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.769720:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788263576.770630:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.770641:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc5139573e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.770653:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.770657:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.770662:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc5139573e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.770674:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc5139573e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.770684:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc5139573e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.770703:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc5139573e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.770724:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788263576.770854:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263576.770864:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc5139573e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.770873:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263576.770878:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc5139573e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.770895:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc5139573e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.770917:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc5139573e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.770924:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc5139573e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.770945:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263576.770948:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc5139573e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.770955:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263576.770958:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc5139573e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.770966:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc5139573e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.770975:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc5139573e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.770980:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc5139573e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.771002:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263576.771004:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263576.771005:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.771061:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.771386:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.771393:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc5139573ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.771403:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.771406:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.771411:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc5139573ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.771422:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc5139573ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.771431:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc5139573ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.771439:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc5139573ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.771454:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788263576.771863:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.771870:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc5139573f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.771886:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.771889:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.771893:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc5139573f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.771903:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc5139573f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.771913:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc5139573f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.771921:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc5139573f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.771945:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788263576.772564:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263576.772576:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc5139573ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.772587:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.772591:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc5139573ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.772601:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc5139573ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.772624:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc5139573ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.772632:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc5139573ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.772656:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263576.772660:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc5139573f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.772665:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.772668:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc5139573f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.772688:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc5139573f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.772698:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc5139573f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.772704:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc5139573f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.772731:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.772732:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.772734:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263576.773510:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.773803:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.773814:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc5139573fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.773830:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.773835:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.773843:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc5139573fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.773857:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc5139573fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.773880:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc5139573fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.773889:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc5139573fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.773917:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263576.774031:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263576.774038:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc5139573fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.774047:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.774052:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc5139573fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.774061:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc5139573fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.774076:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc5139573fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.774095:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc5139573fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.774117:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.774119:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.774121:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.775822:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.775837:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957404 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.775857:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.775862:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.775870:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.775886:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.775898:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957404 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.775907:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.775938:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788263576.779310:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.779341:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc51395740b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779364:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.779370:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.779378:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc51395740b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779395:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc51395740b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779407:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc51395740b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779415:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc51395740b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779443:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788263576.779460:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788263576.779467:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779476:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.779489:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957404 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779499:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957404 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779522:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957404 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779529:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957404 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779550:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263576.779553:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc51395740b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779559:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.779562:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc51395740b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779569:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc51395740b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779578:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc51395740b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779584:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc51395740b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.779602:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.779604:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.779606:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263576.779866:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.781450:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.781468:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513957412 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.781486:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.781490:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.781497:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513957412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.781512:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513957412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.781523:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513957412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.781531:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513957412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.781560:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263576.782949:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263576.782966:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513957412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.782981:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.782987:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513957412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.782999:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513957412 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.783025:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513957412 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.783033:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3c649fc/0x1a657bc513957412 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.783066:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.783068:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.783070:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.783430:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.783441:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1c7ead5/0x1a657bc513957419 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.783465:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.783470:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.783476:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1c7ead5/0x1a657bc513957419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.783490:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1c7ead5/0x1a657bc513957419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.783501:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1c7ead5/0x1a657bc513957419 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.783509:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1c7ead5/0x1a657bc513957419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.783541:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263576.783911:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263576.783918:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1c7ead5/0x1a657bc513957419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.783928:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.783931:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1c7ead5/0x1a657bc513957419 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.783940:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1c7ead5/0x1a657bc513957419 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.783955:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1c7ead5/0x1a657bc513957419 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.783962:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1c7ead5/0x1a657bc513957419 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.783977:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.783979:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.783980:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.789963:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.789980:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957420 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.790000:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.790006:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.790014:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.790032:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.790059:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957420 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.790079:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.790117:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263576.790134:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263576.790143:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.790152:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.790159:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957420 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.790171:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957420 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.790195:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957420 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.790204:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957420 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.790260:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.790269:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.790272:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.792048:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.792059:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513957427 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.792146:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.792150:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.792157:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513957427 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.792172:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513957427 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.792184:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513957427 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.792194:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513957427 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.792309:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788263576.793637:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.793647:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc51395742e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.793660:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.793665:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.793670:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc51395742e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.793690:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc51395742e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.793700:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc51395742e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.793709:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc51395742e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.794291:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263576.794301:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513957427 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.794311:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.794327:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513957427 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.794348:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513957427 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.794366:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513957427 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.794374:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b5a3/0x1a657bc513957427 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.794395:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263576.794398:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc51395742e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.794404:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.794408:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc51395742e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.794416:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc51395742e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.794437:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc51395742e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.794445:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.794447:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.794454:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.794780:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788263576.794787:0:20244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc51395742e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263576.795382:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.795390:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513957435 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.795402:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.795407:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.795413:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513957435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.795426:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513957435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.795459:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513957435 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.795468:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513957435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.795482:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263576.798573:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263576.798587:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513957435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.798602:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.798608:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513957435 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.798620:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513957435 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.798642:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513957435 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.798650:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee585086/0x1a657bc513957435 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.798675:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.798678:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.798680:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.798707:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.801769:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.801787:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc51395743c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.801818:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.801825:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.801832:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc51395743c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.801848:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc51395743c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.801860:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc51395743c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.801869:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc51395743c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.801922:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788263576.802520:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.802530:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513957443 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.802541:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.802544:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.802549:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513957443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.802561:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513957443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.802570:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513957443 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.802579:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513957443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.802597:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788263576.802952:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.802958:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc51395744a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.802968:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.802977:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.802982:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc51395744a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.802993:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc51395744a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.803003:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc51395744a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.803012:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc51395744a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.803022:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788263576.803025:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788263576.803035:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc51395743c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803047:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263576.803053:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc51395743c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803064:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc51395743c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803083:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc51395743c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803091:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0b81eda/0x1a657bc51395743c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803115:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263576.803120:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513957443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803142:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263576.803146:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513957443 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803156:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513957443 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803169:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513957443 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803177:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2cca725/0x1a657bc513957443 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803198:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263576.803202:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc51395744a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803209:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263576.803213:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc51395744a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803240:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc51395744a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803251:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc51395744a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803266:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095f8f5bc/0x1a657bc51395744a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263576.803284:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263576.803288:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263576.803291:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263576.808757:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.810584:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.810599:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc513957451 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.810618:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.810624:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.810632:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc513957451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.810649:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc513957451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.810662:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc513957451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.810678:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc513957451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.810698:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263576.810713:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263576.810719:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc513957451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.810728:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.810733:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc513957451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.810743:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc513957451 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.810760:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc513957451 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.810769:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc513957451 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.811364:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.811366:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.811369:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.814858:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.814884:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957458 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.814904:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.814909:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.814916:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.814935:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.814947:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957458 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.814956:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.814984:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788263576.815694:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263576.815705:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.815718:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.815723:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957458 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.815742:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957458 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.815763:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957458 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.815772:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957458 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.815865:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.815868:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.815870:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.816046:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.816053:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395745f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.816063:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.816067:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.816073:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395745f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.816086:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395745f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.816102:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395745f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.816112:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395745f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.816174:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788263576.817251:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.817261:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957466 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.817274:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.817278:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.817284:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.817295:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.817305:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957466 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.817326:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957466 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.818240:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788263576.818251:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395745f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.818263:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.818268:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395745f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.818278:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395745f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.818296:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395745f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.818329:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395745f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.818348:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263576.818352:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957466 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.818360:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.818363:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957466 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.818372:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957466 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.818383:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957466 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.818391:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.818393:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.818395:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.823893:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788263576.823908:0:20244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957466 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263576.824717:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.824726:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395746d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.824742:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.824746:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.824752:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395746d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.824767:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395746d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.824777:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395746d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.824786:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395746d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.827864:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263576.827879:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395746d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.827893:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.827908:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395746d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.827919:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395746d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.827940:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395746d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.827950:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.827952:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.827953:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.828057:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788263576.828066:0:20244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395746d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263576.829150:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.829160:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957474 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.829174:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.829179:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.829185:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.829197:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.829207:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.829215:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.830305:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263576.830327:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.830339:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.830343:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.830353:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.830372:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957474 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.830382:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.830395:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.830397:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.831301:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788263576.831321:0:20244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957474 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263576.833425:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.833438:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395747b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.833471:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.833476:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.833484:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395747b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.833500:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395747b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.833510:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395747b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.833519:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395747b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788263576.835634:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788263576.839456:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788263576.839474:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395747b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.839490:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:0.0:1788263576.839496:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395747b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.839508:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395747b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.839542:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395747b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263576.839555:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.839558:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788263576.839561:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.839785:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788263576.839855:0:20244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc51395747b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.839891:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.840937:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.840948:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957482 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.840963:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.840968:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.840984:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.840999:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841011:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957482 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841020:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841039:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263576.841049:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263576.841055:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841062:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.841066:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841088:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841103:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957482 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841124:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bcde409/0x1a657bc513957482 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841142:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.841145:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.841147:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.841707:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.841716:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957489 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841729:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.841733:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.841738:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841751:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841761:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957489 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841769:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957489 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841787:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263576.841798:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263576.841810:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957489 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841819:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.841824:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957489 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841834:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957489 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841848:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957489 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841857:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000822fdb49/0x1a657bc513957489 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.841874:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.841876:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.841879:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.869994:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.870010:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957490 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870029:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.870034:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.870042:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957490 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870086:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957490 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870098:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957490 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870108:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957490 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870128:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263576.870143:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263576.870150:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957490 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870158:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.870163:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957490 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870174:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957490 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870192:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957490 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870200:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dac6de06/0x1a657bc513957490 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870250:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.870252:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.870254:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.870739:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.870746:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957497 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870756:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.870760:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.870764:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957497 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870775:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957497 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870782:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957497 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870790:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957497 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870807:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263576.870817:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263576.870822:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957497 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870841:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.870844:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957497 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870851:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957497 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870864:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957497 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870871:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018824dbc/0x1a657bc513957497 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.870886:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.870906:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.870907:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263576.871455:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263576.871463:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395749e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.871472:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=603s v=(0 0) 00010000:00010000:2.0:1788263576.871476:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263576.871481:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395749e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.871491:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395749e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.871506:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395749e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.871514:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395749e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.871529:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263576.871538:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263576.871543:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395749e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.871550:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263576.871554:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395749e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.871563:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395749e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.871575:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395749e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.871583:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016f2520d/0x1a657bc51395749e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263576.871597:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.871613:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263576.871615:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788263576.871781:0:20244:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:2.0:1788263576.871869:0:20244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:19063:x1875129753789440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 142326us (143179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263576.871880:0:20244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788263576.871979:0:19063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19063:1875129753789440:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788263576.871996:0:19063:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:2.0:1788263576.872039:0:19063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19063:1875129753789568:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788263576.872072:0:19063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263576.872111:0:19063:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbcee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263576.872127:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753789568 00000100:00100000:2.0:1788263576.872133:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753789568 00000100:00100000:2.0:1788263576.872168:0:19727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263576.872177:0:19727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:19063:x1875129753789568:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788263576.872212:0:19727:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000001:00100000:2.0:1788263576.918196:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788263576.925610:0:19727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:19063:x1875129753789568:12345-0@lo:5:osp-pre-0-0.0 Request processed in 53422us (53526us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788263576.925628:0:19727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263576.926544:0:19063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:19063:1875129753789568:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788263576.926566:0:19063:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00010000:00010000:2.0:1788263577.275447:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263578.299324:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263579.323686:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263580.348724:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788263581.348351:0:20444:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788263581.348355:0:20444:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788263581.348462:0:20444:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9943744b8800 00000020:01000004:2.0:1788263581.348478:0:20444:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788263581.348500:0:20444:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788263581.348514:0:20444:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99438094cd28) 00000020:00000080:2.0:1788263581.348531:0:20444:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00010000:00010000:2.0:1788263581.371365:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788263581.376382:0:20444:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788263581.376654:0:20444:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788263581.377464:0:20444:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788263581.377716:0:20444:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788263581.379020:0:20444:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1788263581.379570:0:20444:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 523: rc = 0 00100000:10000000:2.0:1788263581.379669:0:20444:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 523: rc = 0 00100000:10000000:2.0:1788263581.379773:0:20444:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 523: rc = 0 00100000:10000000:2.0:1788263581.380206:0:20444:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1788263581.380681:0:20444:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1788263581.381071:0:20444:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1788263581.381496:0:20444:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1788263581.382607:0:20444:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1788263581.382927:0:20444:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00000020:00000080:2.0:1788263581.384794:0:20444:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788263581.384809:0:20444:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788263581.384822:0:20444:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1a657bc5139574ac 00000020:01000004:2.0:1788263581.384831:0:20444:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788263581.384853:0:20444:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788263581.384857:0:20444:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788263581.384862:0:20444:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788263581.384885:0:20444:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788263581.384889:0:20444:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788263581.399665:0:20444:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788263581.399717:0:20444:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.129@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788263581.399723:0:20444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788263581.399724:0:20444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788263581.399726:0:20444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263581.399727:0:20444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263581.399728:0:20444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263581.399729:0:20444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263581.399731:0:20444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263581.399732:0:20444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263581.399734:0:20444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788263581.399737:0:20444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788263581.399740:0:20444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788263581.399741:0:20444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788263581.399742:0:20444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263581.399743:0:20444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263581.399744:0:20444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263581.399745:0:20444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263581.399746:0:20444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263581.399747:0:20444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263581.399749:0:20444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788263581.399781:0:20444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788263581.399803:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753789696:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788263581.399893:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263581.399959:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263581.400277:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753789696 00000100:00100000:0.0:1788263581.400287:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753789696 00000100:00100000:0.0:1788263581.400340:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788263581.400349:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:20444:x1875129753789696:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788263581.400380:0:19035:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788263581.400384:0:19035:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788263581.400388:0:19035:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788263581.427663:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:20444:x1875129753789696:12345-0@lo:253:mount.lustre.0 Request processed in 27305us (27759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263581.427681:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788263581.428439:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753789696:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788263581.428458:0:20444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788263581.428461:0:20444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788263581.428463:0:20444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788263581.428465:0:20444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788263581.428466:0:20444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788263581.428467:0:20444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788263581.428468:0:20444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788263581.428469:0:20444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788263581.428471:0:20444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788263581.428472:0:20444:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788263581.428494:0:20444:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9943744b8800 from lustre-OST0001 10000000:01000000:3.0:1788263581.428597:0:20444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788263581.428601:0:20444:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788263581.428609:0:20444:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff994346b319b8 local copy 00010000:00010000:3.0:1788263581.428620:0:20444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957244 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263581.428944:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753789824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263581.428996:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263581.429109:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263581.430389:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753789824 00000100:00100000:0.0:1788263581.430398:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753789824 00000100:00100000:0.0:1788263581.430453:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788263581.430473:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:20444:x1875129753789824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263581.430689:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:20444:x1875129753789824:12345-0@lo:501:mount.lustre.0 Request processed in 217us (1693us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788263581.430697:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788263581.430969:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753789824:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788263581.430988:0:20444:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788263581.431125:0:20444:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788263581.431134:0:20444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957244 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263581.431352:0:20444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380658e00/0x1a657bc51395723d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957244 expref: -99 pid: 19022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263581.431388:0:20444:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9943744b8800 10000000:01000000:3.0:1788263581.431393:0:20444:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788263581.431398:0:20444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788263581.431400:0:20444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788263581.431405:0:20444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788263581.431407:0:20444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788263581.431434:0:20444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc5139574b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263581.431442:0:20444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc5139574b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263581.431452:0:20444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc5139574b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263581.431469:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753789952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263581.431501:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263581.431534:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263581.431594:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753789952 00000100:00100000:1.0:1788263581.431599:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753789952 00000100:00100000:1.0:1788263581.431625:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788263581.431632:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:20444:x1875129753789952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263581.431641:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263581.431652:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242899e00/0x1a657bc5139574ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139574b3 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263581.431673:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242899e00/0x1a657bc5139574ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139574b3 expref: 17 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263581.431682:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242899e00/0x1a657bc5139574ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139574b3 expref: 17 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263581.431702:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899e00, rc 0) 00000100:00100000:1.0:1788263581.431808:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:20444:x1875129753789952:12345-0@lo:101:mount.lustre.0 Request processed in 176us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263581.431814:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788263581.431918:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753789952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788263581.431930:0:20444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc5139574b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139574ba expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263581.431939:0:20444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc5139574b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139574ba expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263581.433929:0:20444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:3.0:1788263581.436010:0:20444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263581.437949:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788263581.438053:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788263581.438091:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788263581.439019:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788263581.439090:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788263581.439125:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788263581.439700:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788263581.439850:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788263581.439927:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1788263581.440013:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1788263581.440022:0:20444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1788263581.440395:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263581.440469:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263581.440561:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99435bf0f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263581.440886:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753790080 00000100:00100000:2.0:1788263581.440901:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753790080 00000100:00100000:2.0:1788263581.440987:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788263581.440997:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:20444:x1875129753790080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788263581.444433:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:20444:x1875129753790080:12345-0@lo:501:mount.lustre.0 Request processed in 3431us (3957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263581.444448:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788263581.444564:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790080:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263581.444618:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790208:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263581.444667:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263581.445044:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943509c0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788263581.445118:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753790208 00000100:00100000:1.0:1788263581.445126:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753790208 00000100:00100000:1.0:1788263581.445173:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788263581.445182:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:20444:x1875129753790208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263581.445541:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:20444:x1875129753790208:12345-0@lo:503:mount.lustre.0 Request processed in 359us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263581.445548:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788263581.445766:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790208:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788263581.446459:0:20444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263581.446533:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263581.446589:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263581.446617:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943509c0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788263581.447380:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753790336 00000100:00100000:1.0:1788263581.447388:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753790336 00000100:00100000:1.0:1788263581.447425:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788263581.447435:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994243939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:20444:x1875129753790336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263581.447695:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994243939850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:20444:x1875129753790336:12345-0@lo:502:mount.lustre.0 Request processed in 260us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263581.447704:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788263581.449525:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788263581.449917:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788263581.449984:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788263581.450015:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788263581.450057:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788263581.450093:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788263581.450124:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788263581.450189:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788263581.450276:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788263581.450338:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788263581.450380:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790464:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263581.450450:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263581.450487:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375e8ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263581.450987:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753790464 00000100:00100000:0.0:1788263581.450994:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753790464 00000100:00100000:0.0:1788263581.451037:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788263581.451046:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994243938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:20444:x1875129753790464:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263581.451326:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994243938050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:20444:x1875129753790464:12345-0@lo:502:mount.lustre.0 Request processed in 280us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263581.451334:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788263581.451944:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788263581.452042:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1788263581.452053:0:20444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788263581.455485:0:20445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788263581.455499:0:20445:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788263581.455579:0:20445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263581.455581:0:20445:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788263581.455587:0:20445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788263581.455605:0:20445:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff994346b33370) 00000020:00000080:1.0:1788263581.455637:0:20445:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788263581.455642:0:20445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788263581.455791:0:20445:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9943744b8800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788263581.455799:0:20445:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788263581.455807:0:20445:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x1a657bc5139574c8 00010000:00010000:1.0:1788263581.461480:0:20445:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788263581.462087:0:20445:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:1.0:1788263581.464904:0:20445:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:1.0:1788263581.466127:0:20445:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788263581.466148:0:20445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263581.466154:0:20445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263581.466156:0:20445:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788263581.466160:0:20445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263581.466163:0:20445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263581.466165:0:20445:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788263581.466168:0:20445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788263581.466170:0:20445:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788263581.466172:0:20445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263581.466181:0:20445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263581.466182:0:20445:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788263581.466185:0:20445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788263581.466187:0:20445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263581.466188:0:20445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788263581.466191:0:20445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788263581.466413:0:20445:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788263581.466417:0:20445:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788263581.466419:0:20445:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788263581.466422:0:20445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788263581.469057:0:20444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788263581.469108:0:20444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788263581.469394:0:20444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc5139574b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139574ba expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263581.469409:0:20444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343159600/0x1a657bc5139574b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139574ba expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263581.469419:0:20444:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9943744b8800 from 1 10000000:01000000:3.0:1788263581.469422:0:20444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263581.469474:0:20444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263581.469482:0:20444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263581.469519:0:20444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263581.469548:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788263581.469618:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263581.469658:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263581.469837:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753790592 00000100:00100000:2.0:1788263581.469845:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753790592 00000100:00100000:2.0:1788263581.469902:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788263581.469912:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99424393a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:20444:x1875129753790592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263581.469926:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263581.469938:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994380659400/0x1a657bc5139574d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139574cf expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.469961:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380659400/0x1a657bc5139574d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139574cf expref: 18 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.469972:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994380659400/0x1a657bc5139574d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139574cf expref: 18 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.469981:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380659400, rc 0) 00000100:00100000:2.0:1788263581.470028:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99424393a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:20444:x1875129753790592:12345-0@lo:101:mount.lustre.0 Request processed in 117us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263581.470035:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788263581.470114:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788263581.470127:0:20444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263581.470149:0:20444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788263581.470763:0:20444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:1.0:1788263581.471285:0:20444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788263581.471527:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788263581.471575:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788263581.471642:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788263581.471681:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788263581.471715:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788263581.471761:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788263581.471799:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788263581.471836:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788263581.471907:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788263581.471917:0:20444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:1.0:1788263581.471990:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263581.472053:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263581.472095:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263581.472383:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753790720 00000100:00100000:2.0:1788263581.472391:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753790720 00000100:00100000:2.0:1788263581.472440:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788263581.472452:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994243938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:20444:x1875129753790720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263581.472676:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994243938850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:20444:x1875129753790720:12345-0@lo:501:mount.lustre.0 Request processed in 225us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263581.472683:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788263581.474388:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788263581.474470:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788263581.475938:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263581.477282:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff994379f30cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263581.484406:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753790848 00000100:00100000:2.0:1788263581.484423:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753790848 00000100:00100000:2.0:1788263581.484486:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788263581.484497:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994243938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:20444:x1875129753790848:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263581.484764:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994243938450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:20444:x1875129753790848:12345-0@lo:503:mount.lustre.0 Request processed in 266us (8830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263581.484772:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788263581.484943:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788263581.485545:0:20444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788263581.485621:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263581.485677:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263581.485722:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943509c0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263581.485979:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753790976 00000100:00100000:2.0:1788263581.485985:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753790976 00000100:00100000:2.0:1788263581.486022:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788263581.486030:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99424393b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:20444:x1875129753790976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263581.486253:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99424393b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:20444:x1875129753790976:12345-0@lo:502:mount.lustre.0 Request processed in 223us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263581.486260:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788263581.486412:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753790976:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263581.486669:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788263581.486717:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788263581.486763:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788263581.486798:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788263581.486831:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788263581.486875:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788263581.486911:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788263581.486942:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788263581.486975:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791104:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788263581.487020:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263581.487046:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f9ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263581.487271:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753791104 00000100:00100000:0.0:1788263581.487277:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753791104 00000100:00100000:0.0:1788263581.487315:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788263581.487322:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:20444:x1875129753791104:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788263581.487483:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:20444:x1875129753791104:12345-0@lo:502:mount.lustre.0 Request processed in 160us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263581.487490:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788263581.487655:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791104:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788263581.487745:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788263581.487755:0:20444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788263581.490024:0:20449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263581.490040:0:20449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263581.490042:0:20449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788263581.490050:0:20449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9943744b8800 00000020:00000080:3.0:1788263581.490052:0:20449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263581.490061:0:20449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263581.490071:0:20449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263581.490072:0:20449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788263581.490076:0:20449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263581.490078:0:20449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263581.490080:0:20449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788263581.490083:0:20449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9943744b8800 00000020:00000080:3.0:1788263581.490085:0:20449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263581.491078:0:20449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263581.491087:0:20449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263581.491088:0:20449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788263581.491092:0:20449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788263581.491095:0:20449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263581.491096:0:20449:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788263581.491100:0:20449:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9943744b8800 00000020:00000080:3.0:1788263581.491103:0:20449:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788263581.491269:0:20449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788263581.491274:0:20449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788263581.491275:0:20449:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788263581.491279:0:20449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:2.0:1788263581.501388:0:20444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788263581.501442:0:20444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788263581.501474:0:20444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.501488:0:20444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263581.501548:0:20444:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788263581.501551:0:20444:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9943744b8800 10000000:01000000:2.0:1788263581.501554:0:20444:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9943744b8800 10000000:01000000:2.0:1788263581.501557:0:20444:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788263581.501563:0:20444:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9943744b8800 from 1 10000000:01000000:2.0:1788263581.501566:0:20444:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788263581.501601:0:20444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658a00/0x1a657bc5139574dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.501623:0:20444:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994380658a00/0x1a657bc5139574dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.501635:0:20444:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994380658a00/0x1a657bc5139574dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263581.501658:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788263581.501727:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263581.509478:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943507edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263581.510374:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753791232 00000100:00100000:0.0:1788263581.510388:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753791232 00000100:00100000:0.0:1788263581.510443:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788263581.510453:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:20444:x1875129753791232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788263581.510471:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263581.510489:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d800/0x1a657bc5139574e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc5139574dd expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263581.510519:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d800/0x1a657bc5139574e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc5139574dd expref: 19 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263581.510530:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d800/0x1a657bc5139574e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139574dd expref: 19 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263581.510539:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d800, rc 0) 00000100:00100000:0.0:1788263581.510610:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:20444:x1875129753791232:12345-0@lo:101:mount.lustre.0 Request processed in 158us (8882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263581.510616:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788263581.512626:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791232:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788263581.512660:0:20444:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994380658a00/0x1a657bc5139574dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139574e4 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.512675:0:20444:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994380658a00/0x1a657bc5139574dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139574e4 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788263581.513839:0:20444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1788263581.514782:0:20444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788263581.515077:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788263581.515124:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788263581.519441:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788263581.519533:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788263581.519588:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788263581.519640:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788263581.519677:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788263581.519709:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788263581.519756:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788263581.519790:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788263581.519836:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788263581.519883:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788263581.519919:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788263581.519949:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788263581.519990:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788263581.520023:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788263581.520055:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788263581.520102:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788263581.523380:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788263581.523494:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788263581.523599:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788263581.523638:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788263581.523670:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788263581.523734:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788263581.523773:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1788263581.523808:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1788263581.523855:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1788263581.523889:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1788263581.523920:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1788263581.523965:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1788263581.523996:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1788263581.524028:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1788263581.524061:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1788263581.524106:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1788263581.526493:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1788263581.526985:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1788263581.527047:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1788263581.527080:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:2.0:1788263581.527130:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:2.0:1788263581.530036:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:2.0:1788263581.530476:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:2.0:1788263581.530486:0:20444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:2.0:1788263581.530644:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263581.530719:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263581.530769:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943507edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263581.531259:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753791360 00000100:00100000:0.0:1788263581.531275:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753791360 00000100:00100000:0.0:1788263581.531327:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788263581.531336:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:20444:x1875129753791360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788263581.532785:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:20444:x1875129753791360:12345-0@lo:501:mount.lustre.0 Request processed in 1443us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263581.532797:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788263581.532936:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791360:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788263581.532981:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791488:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788263581.533026:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263581.533063:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943507edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263581.533112:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753791488 00000100:00100000:0.0:1788263581.533119:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753791488 00000100:00100000:0.0:1788263581.535725:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788263581.535745:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:20444:x1875129753791488:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788263581.535981:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:20444:x1875129753791488:12345-0@lo:503:mount.lustre.0 Request processed in 241us (2954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263581.535989:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788263581.536761:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791488:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788263581.537354:0:20444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788263581.537434:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263581.537500:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263581.538157:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943507edd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263581.538410:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753791616 00000100:00100000:1.0:1788263581.538418:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753791616 00000100:00100000:1.0:1788263581.538460:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788263581.538471:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:20444:x1875129753791616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263581.538745:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:20444:x1875129753791616:12345-0@lo:502:mount.lustre.0 Request processed in 274us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263581.538753:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788263581.538852:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263581.539123:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788263581.539184:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788263581.539259:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788263581.539311:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788263581.539348:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788263581.539409:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788263581.539447:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788263581.539479:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788263581.539537:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788263581.539569:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788263581.539599:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788263581.539641:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788263581.539675:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788263581.539707:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788263581.539777:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788263581.539823:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788263581.539859:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788263581.539906:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788263581.539942:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788263581.539996:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788263581.540044:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788263581.540080:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788263581.540113:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788263581.540161:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788263581.540210:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:2.0:1788263581.540280:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:2.0:1788263581.540342:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:2.0:1788263581.540383:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:2.0:1788263581.540414:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:2.0:1788263581.540460:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:2.0:1788263581.540494:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:2.0:1788263581.540528:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:2.0:1788263581.540561:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:2.0:1788263581.540608:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:2.0:1788263581.540644:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:2.0:1788263581.540691:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:2.0:1788263581.540727:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:2.0:1788263581.540760:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:2.0:1788263581.540807:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:2.0:1788263581.540840:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:2.0:1788263581.540889:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788263581.540965:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263581.541005:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943507edd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788263581.541568:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753791744 00000100:00100000:1.0:1788263581.541576:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753791744 00000100:00100000:1.0:1788263581.541614:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788263581.541622:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:20444:x1875129753791744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788263581.541858:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:20444:x1875129753791744:12345-0@lo:502:mount.lustre.0 Request processed in 236us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263581.541866:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788263581.542030:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753791744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788263581.542123:0:20444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1788263581.542148:0:20444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788263581.549092:0:20454:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788263581.549112:0:20454:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9943464399b8) 00000020:00000080:1.0:1788263581.550443:0:20454:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788263581.550710:0:20454:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9943744b8800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788263581.550716:0:20454:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9943744b8800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788263581.550719:0:20454:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9943744b8800 3 00010000:00080000:2.0:1788263581.550756:0:20454:0:(ldlm_lib.c:102:import_set_conn()) imp ffff994242836000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.129@tcp at head 00010000:00010000:3.0:1788263581.553987:0:20454:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788263581.554604:0:20454:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788263581.554645:0:20454:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788263581.554655:0:20454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x1a657bc5139574f2 00000100:00080000:3.0:1788263581.554666:0:20454:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788263581.554671:0:20454:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff994242836000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788263581.554704:0:20454:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9943755bdc00 x1875129753791872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788263581.554733:0:20454:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788263581.554970:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1875129753791872:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788263581.555037:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263581.555491:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753791872 00000100:00100000:3.0:1788263581.555499:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753791872 00000100:00100000:3.0:1788263581.555539:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263581.555547:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3319:x1875129753791872:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788263581.555592:0:19042:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 608 last 0 00000020:00000080:3.0:1788263581.555622:0:19042:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x1a657bc5139574f9 00000004:00100000:3.0:1788263581.555637:0:19042:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788263581.555668:0:19042:0:(import.c:65:import_set_state_nolock()) ffff994346468800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788263581.555720:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875129753791872:12345-0@lo:38:llog_process_th.0 Request processed in 173us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263581.555728:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788263581.555930:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788263581.555935:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788263581.555938:0:37:0:(import.c:65:import_set_state_nolock()) ffff994375e65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788263581.555943:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 603 00000100:00080000:0.0:1788263581.555947:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788263581.555951:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994375e65800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788263581.555968:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99438118ad80 x1875129753792128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788263581.556101:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753792000:0@lo:400:kworker.0 00000100:00100000:3.0:1788263581.556145:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263581.556176:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788263581.556182:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753792256:0@lo:400:kworker.0 00000100:00100000:3.0:1788263581.556205:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263581.556402:0:19726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753792000 00000100:00100000:0.0:1788263581.556408:0:19726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753792000 00000100:00100000:0.0:1788263581.556458:0:19726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788263581.556466:0:19726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753792000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788263581.556506:0:19726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753792000:12345-0@lo:400:kworker.0 Request processed in 41us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263581.556521:0:19726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263581.556611:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753792256 00000100:00100000:1.0:1788263581.556615:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753792256 00000100:00100000:1.0:1788263581.556645:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263581.556652:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753792256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263581.556685:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1875129753792256:12345-0@lo:400:kworker.0 Request processed in 34us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263581.556698:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263581.556725:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753792384:0@lo:400:kworker.0 00000100:00100000:1.0:1788263581.556751:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263581.556777:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753792384 00000100:00100000:1.0:1788263581.556780:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753792384 00000100:00100000:1.0:1788263581.556797:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263581.556802:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753792384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263581.556833:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875129753792384:12345-0@lo:400:kworker.0 Request processed in 30us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263581.556839:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788263581.556867:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99438118b100 x1875129753792384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788263581.556876:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1875129753792384:0@lo:400:kworker.0 00000100:00080000:3.0:1788263581.558415:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788263581.558423:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788263581.558462:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff994381188a80 x1875129753792256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263581.558475:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1875129753792256:0@lo:400:kworker.0 00000100:00100000:3.0:1788263581.558491:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753792000:0@lo:400:kworker.0 00000100:00100000:3.0:1788263581.558844:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753792128:0@lo:8:kworker.0 00000100:00100000:3.0:1788263581.558897:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788263581.558945:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9943755bdc00 x1875129753791872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788263591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263581.558954:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788263581.558963:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788263581.558978:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788263581.558983:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788263581.558987:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994242836000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788263581.558994:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9943755bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1875129753791872:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788263581.559176:0:20454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000100:00100000:2.0:1788263581.559316:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753792128 00000100:00100000:2.0:1788263581.559323:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753792128 00000100:00100000:2.0:1788263581.559348:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263581.559355:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3319:x1875129753792128:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788263581.559416:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3319:x1875129753792128:12345-0@lo:8:kworker.0 Request processed in 60us (517us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788263581.559422:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263581.559452:0:3319:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788263581.559456:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994375e65800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788263581.559460:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788263581.559463:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753792128:0@lo:8:kworker.0 00000020:01000000:1.0:1788263581.560363:0:20444:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788263581.560398:0:20444:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788263581.560418:0:20444:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658a00/0x1a657bc5139574dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139574e4 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263581.560430:0:20444:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380658a00/0x1a657bc5139574dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139574e4 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788263581.560479:0:20444:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788263581.560482:0:20444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788263581.560483:0:20444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263581.560485:0:20444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263581.560486:0:20444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263581.560487:0:20444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263581.560489:0:20444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263581.560494:0:20444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263581.560495:0:20444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788263581.560498:0:20444:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788263581.560501:0:20444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788263581.560502:0:20444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788263581.560502:0:20444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263581.560503:0:20444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263581.560505:0:20444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263581.560506:0:20444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263581.560507:0:20444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263581.560507:0:20444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263581.560508:0:20444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788263581.560531:0:20444:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788263581.560547:0:20444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753792512:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788263581.560594:0:20444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263581.560627:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753792512 00000100:00100000:1.0:1788263581.560632:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753792512 00000100:00100000:1.0:1788263581.560667:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788263581.560674:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:20444:x1875129753792512:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788263581.560709:0:19034:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788263581.560723:0:19034:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788263581.561048:0:20444:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbcea80 going to sleep for 11 seconds 20000000:01000000:3.0:1788263581.594622:0:19034:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788263581.594671:0:19034:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788263581.594774:0:19056:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788263581.594780:0:19056:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788263581.594803:0:19056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263581.594819:0:19056:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994242899c00/0x1a657bc5139573be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139573b7 expref: 19 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263581.594827:0:19056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263581.594865:0:19056:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994242899c00/0x1a657bc5139573be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc5139573b7 expref: 19 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263581.594879:0:19056:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994242899c00/0x1a657bc5139573be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc5139573b7 expref: 19 pid: 19033 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263581.594893:0:19056:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19056:1875129753792640:0@lo:104: 00000100:00100000:0.0:1788263581.594959:0:19056:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263581.595006:0:19056:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788263581.595066:0:19024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753792640 00000100:00100000:2.0:1788263581.595074:0:19024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753792640 00000100:00100000:2.0:1788263581.595123:0:19024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263581.595144:0:19024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+3:19056:x1875129753792640:12345-0@lo:104: 00010000:00010000:2.0:1788263581.595158:0:19024:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595245:0:19024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263581.595252:0:19024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+3:19056:x1875129753792640:12345-0@lo:104: Request processed in 121us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263581.595258:0:19024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788263581.595294:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263581.595300:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595306:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263581.595310:0:19029:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595318:0:19029:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263581.595324:0:19029:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263581.595329:0:19029:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788263581.595355:0:19029:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595361:0:19029:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263581.595382:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595390:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343158600/0x1a657bc5139573b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139573be expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595404:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263581.595406:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263581.595407:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263581.595426:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3321:1875129753792768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263581.595454:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263581.595499:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753792768 00000100:00100000:2.0:1788263581.595503:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753792768 00010000:00010000:2.0:1788263581.595518:0:19027:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994242899c00/0x1a657bc5139573be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139573b7 expref: 20 pid: 19033 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263581.595539:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263581.595545:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+20:3321:x1875129753792768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263581.595555:0:19027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263581.595559:0:19027:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994242899c00/0x1a657bc5139573be lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139573b7 expref: 20 pid: 19033 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595569:0:19027:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994242899c00/0x1a657bc5139573be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc5139573b7 expref: 20 pid: 19033 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595584:0:19027:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595591:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788263581.595602:0:19027:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001601398s 00010000:00010000:2.0:1788263581.595606:0:19027:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595612:0:19027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595618:0:19027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595639:0:19027:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595654:0:19027:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216c000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263581.595659:0:19027:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595665:0:19027:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595672:0:19027:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263581.595681:0:19027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263581.595708:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+20:3321:x1875129753792768:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263581.595715:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263581.595829:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3321:1875129753792768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788263581.596039:0:19056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994242899c00/0x1a657bc5139573be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc5139573b7 expref: 19 pid: 19033 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263581.596050:0:19056:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:19056:1875129753792640:0@lo:104: 00010000:00010000:3.0:1788263581.596061:0:19056:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263581.596069:0:19056:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263581.596075:0:19056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263581.596081:0:19056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216c000/0x1a657bc513957500 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263581.605402:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:20444:x1875129753792512:12345-0@lo:253:mount.lustre.0 Request processed in 44717us (44796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263581.605418:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788263581.605543:0:20444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:20444:1875129753792512:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788263581.605560:0:20444:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788263581.605564:0:20444:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788263581.605566:0:20444:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788263581.605567:0:20444:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788263581.605568:0:20444:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788263581.605569:0:20444:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788263581.605571:0:20444:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788263581.605572:0:20444:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788263581.605574:0:20444:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788263581.605575:0:20444:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788263581.605589:0:20444:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788263581.605996:0:20444:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263581.606317:0:20444:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263581.606472:0:20444:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263581.606617:0:20444:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788263581.606753:0:20444:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788263581.606946:0:20444:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788263581.607891:0:20444:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788263581.654063:0:20444:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788263581.654076:0:20444:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788263581.654117:0:20444:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788263581.654317:0:20444:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788263581.654337:0:20444:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788263581.654381:0:20444:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:2.0:1788263581.952034:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753792896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263581.952115:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263581.952601:0:19730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753792896 00000100:00100000:2.0:1788263581.952609:0:19730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753792896 00000100:00100000:2.0:1788263581.952665:0:19730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263581.952677:0:19730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753792896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788263581.952709:0:19730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788263581.952759:0:19730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1875129753792896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263581.952766:0:19730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263581.952819:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753792896:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788263582.049469:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:2.0:1788263582.395397:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788263582.975318:0:19037:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788263582.975325:0:19037:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99437fb8c000 from 11 10000000:01000000:2.0:1788263582.975331:0:19037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788263582.975377:0:19037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658800/0x1a657bc513957507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263582.975389:0:19037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994380658800/0x1a657bc513957507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263582.975402:0:19037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994380658800/0x1a657bc513957507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263582.975426:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753793024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263582.975494:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263582.975537:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434676cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788263582.975786:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753793024 00000100:00100000:2.0:1788263582.975794:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753793024 00000100:00100000:2.0:1788263582.975843:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788263582.975853:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:19037:x1875129753793024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263582.975866:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263582.975879:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994380658c00/0x1a657bc51395750e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513957507 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263582.975903:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994380658c00/0x1a657bc51395750e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513957507 expref: 19 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263582.975915:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994380658c00/0x1a657bc51395750e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513957507 expref: 19 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263582.975938:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994380658c00, rc 0) 00000100:00100000:2.0:1788263582.975974:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:19037:x1875129753793024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263582.975981:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788263582.976034:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753793024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263582.976050:0:19037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994380658800/0x1a657bc513957507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395750e expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263582.976060:0:19037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994380658800/0x1a657bc513957507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc51395750e expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263582.976111:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753793152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788263582.976143:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263582.976159:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349694c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788263582.976171:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753793152 00000100:00100000:2.0:1788263582.976175:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753793152 00000100:00100000:2.0:1788263582.976196:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788263582.976202:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:19037:x1875129753793152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788263582.976249:0:19034:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788263582.976267:0:19034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788263582.976270:0:19034:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788263582.976344:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:19037:x1875129753793152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263582.976352:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788263582.976383:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753793152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788263582.976450:0:19037:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788263582.976457:0:19037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994380658800/0x1a657bc513957507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395750e expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263582.976466:0:19037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994380658800/0x1a657bc513957507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc51395750e expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263583.419385:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788263583.684815:0:19070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788263584.444559:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263585.468319:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263586.492830:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788263587.067631:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788263587.067637:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788263587.067641:0:37:0:(import.c:65:import_set_state_nolock()) ffff994375e65800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788263587.067652:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff994375e65800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788263587.067676:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff994379f24700 x1875129753793536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788263587.067732:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3323:1875129753793280:0@lo:400:kworker.0 00000100:00100000:2.0:1788263587.067810:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263587.067859:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753793920:0@lo:400:kworker.0 00000100:00100000:2.0:1788263587.067887:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263587.067914:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263587.067920:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753793792:0@lo:400:kworker.0 00000100:00100000:2.0:1788263587.067947:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263587.067977:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753793408:0@lo:400:kworker.0 00000100:00100000:2.0:1788263587.068020:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263587.068870:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263587.068880:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753793664:0@lo:400:kworker.0 00000100:00100000:2.0:1788263587.068917:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263587.068957:0:3319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994379f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753793536:0@lo:8:kworker.0 00000100:00100000:2.0:1788263587.068986:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263587.069020:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753793280 00000100:00100000:2.0:1788263587.069028:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753793280 00000100:00100000:2.0:1788263587.069199:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788263587.069208:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:3323:x1875129753793280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263587.069277:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:3323:x1875129753793280:12345-0@lo:400:kworker.0 Request processed in 69us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263587.069284:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788263587.069322:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753793920 00000100:00100000:2.0:1788263587.069326:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753793920 00000100:00100000:2.0:1788263587.069359:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753793792 00000100:00100000:2.0:1788263587.069362:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753793792 00000100:00100000:2.0:1788263587.069373:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753793664 00000100:00100000:2.0:1788263587.069375:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753793664 00000100:00100000:2.0:1788263587.069386:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263587.069391:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753793920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263587.069425:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1875129753793920:12345-0@lo:400:kworker.0 Request processed in 33us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263587.069431:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263587.069444:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788263587.069451:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753793792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263587.069476:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1875129753793792:12345-0@lo:400:kworker.0 Request processed in 27us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263587.069494:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788263587.069505:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263587.069510:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753793664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263587.069545:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875129753793664:12345-0@lo:400:kworker.0 Request processed in 34us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263587.069550:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788263587.069570:0:19726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753793408 00000100:00100000:2.0:1788263587.069573:0:19726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753793408 00000100:00100000:2.0:1788263587.070772:0:19726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753793536 00000100:00100000:2.0:1788263587.070783:0:19726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753793536 00000100:00100000:2.0:1788263587.070822:0:19726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263587.070834:0:19726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753793408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263587.070899:0:19726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875129753793408:12345-0@lo:400:kworker.0 Request processed in 69us (2878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263587.070906:0:19726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788263587.070921:0:19726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263587.070925:0:19726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3319:x1875129753793536:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788263587.070950:0:19726:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 613 last 0 00000020:00000080:2.0:1788263587.072707:0:19726:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x1a657bc513957515 00002000:00100000:2.0:1788263587.072729:0:19726:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff994242833800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788263587.072735:0:19726:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788263587.072737:0:19726:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788263587.073837:0:19726:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788263587.073881:0:19726:0:(import.c:65:import_set_state_nolock()) ffff994242834000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263587.076213:0:19726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1875129753793536:12345-0@lo:8:kworker.0 Request processed in 5275us (7216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263587.076249:0:19726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788263587.076305:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263587.076311:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788263587.076359:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994379f24700 x1875129753793536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788263612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788263587.076377:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788263587.076386:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788263587.076392:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788263587.076395:0:3319:0:(import.c:65:import_set_state_nolock()) ffff994375e65800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788263587.076419:0:3319:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788263587.076425:0:3319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1875129753793536:0@lo:8:kworker.0 00000004:00080000:2.0:1788263587.076489:0:19065:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788263587.076508:0:19065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19065:1875129753794176:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788263587.076561:0:19065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263587.076584:0:19065:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375e8ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788263587.076599:0:20244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753794176 00000100:00100000:2.0:1788263587.076604:0:20244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753794176 00000100:00100000:2.0:1788263587.076648:0:20244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263587.076656:0:20244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:19065:x1875129753794176:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788263587.077687:0:19064:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788263587.078090:0:19064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 613865871298ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788263587.079353:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753794304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263587.079432:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263587.079485:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788263587.079492:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753794048:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263587.079500:0:19730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753794304 00000100:00100000:2.0:1788263587.079509:0:19730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753794304 00000100:00100000:3.0:1788263587.079516:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263587.079545:0:19730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753794048 00000100:00100000:2.0:1788263587.079548:0:19730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753794048 00000100:00100000:3.0:1788263587.079553:0:19731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263587.079561:0:19731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753794304:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788263587.079566:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788263587.079593:0:19731:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788263587.079635:0:19731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753794304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263587.079643:0:19731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788263587.079660:0:19731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788263587.079666:0:19731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1875129753794048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263587.079684:0:19731:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263587.079711:0:19731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1875129753794048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263587.079717:0:19731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788263587.079752:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99437a7bb800 x1875129753794048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788263603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263587.079773:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753794048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263587.079786:0:3321:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788263587.079802:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994381188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753794304:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788263587.079832:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994379f27100 x1875129753793664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263587.079842:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875129753793664:0@lo:400:kworker.0 00000100:00100000:3.0:1788263587.079857:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753793408:0@lo:400:kworker.0 00010000:00080000:3.0:1788263587.079901:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994379f25f80 x1875129753793792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263587.079911:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1875129753793792:0@lo:400:kworker.0 00000100:00100000:3.0:1788263587.079922:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3323:1875129753793280:0@lo:400:kworker.0 00010000:00080000:3.0:1788263587.079934:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff994379f27800 x1875129753793920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788263603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788263587.079942:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994379f27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1875129753793920:0@lo:400:kworker.0 00002000:00080000:2.0:1788263587.094353:0:20244:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788263587.094365:0:20244:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:2.0:1788263587.094370:0:20244:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:65) 00002000:00010000:2.0:1788263587.112277:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.112290:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc51395751c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112309:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.112314:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.112321:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc51395751c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112341:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc51395751c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112351:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc51395751c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112361:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc51395751c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112379:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.112389:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.112395:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc51395751c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112402:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.112407:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc51395751c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112426:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc51395751c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112443:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc51395751c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112451:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2cca725/0x1a657bc51395751c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112469:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.112471:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.112473:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.112902:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.112909:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513957523 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112918:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.112921:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.112926:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513957523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112935:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513957523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112943:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513957523 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112957:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513957523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112970:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.112979:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.112983:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513957523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.112990:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.112994:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513957523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113001:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513957523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113012:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513957523 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113019:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0b81eda/0x1a657bc513957523 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113031:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.113033:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.113034:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.113459:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.113471:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095f8f5bc/0x1a657bc51395752a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113480:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.113484:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.113488:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095f8f5bc/0x1a657bc51395752a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113498:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095f8f5bc/0x1a657bc51395752a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113505:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095f8f5bc/0x1a657bc51395752a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113512:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095f8f5bc/0x1a657bc51395752a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113526:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.113535:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.113539:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095f8f5bc/0x1a657bc51395752a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113546:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.113549:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095f8f5bc/0x1a657bc51395752a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113557:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095f8f5bc/0x1a657bc51395752a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113572:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095f8f5bc/0x1a657bc51395752a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113578:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095f8f5bc/0x1a657bc51395752a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113590:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.113591:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.113593:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.113926:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.113932:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513957531 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113940:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.113943:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.113947:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513957531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113956:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513957531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113963:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513957531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113970:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513957531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.113993:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.114003:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.114007:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513957531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114013:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.114016:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513957531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114023:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513957531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114033:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513957531 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114040:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5b1b5a3/0x1a657bc513957531 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114052:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.114054:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.114056:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.114477:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.114483:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513957538 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114492:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.114500:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.114504:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513957538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114513:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513957538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114521:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513957538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114528:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513957538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114552:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263587.114579:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263587.114588:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513957538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.114598:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263587.114602:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513957538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.114612:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513957538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.114691:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513957538 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.114700:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee585086/0x1a657bc513957538 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.114734:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.114737:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.114740:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.114951:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.114957:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc51395753f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114966:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.114969:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.114973:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc51395753f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114982:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc51395753f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.114990:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc51395753f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.115003:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc51395753f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.115022:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263587.115101:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263587.115106:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc51395753f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.115114:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263587.115118:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc51395753f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.115128:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc51395753f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.115151:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc51395753f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.115159:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bcde409/0x1a657bc51395753f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.115173:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.115174:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.115176:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.117669:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.117683:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513957546 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.117699:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.117704:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.117710:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513957546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.117724:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513957546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.117734:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513957546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.117742:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513957546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.120600:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788263587.121181:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.121191:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f2520d/0x1a657bc51395754d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.121214:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.121237:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.121244:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016f2520d/0x1a657bc51395754d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.121258:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016f2520d/0x1a657bc51395754d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.121267:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016f2520d/0x1a657bc51395754d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.121275:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016f2520d/0x1a657bc51395754d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.121597:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263587.121605:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513957546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.121625:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380659c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263587.121631:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513957546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.121640:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513957546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.121657:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513957546 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.121664:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018824dbc/0x1a657bc513957546 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.121682:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263587.121685:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016f2520d/0x1a657bc51395754d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.121692:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994380658400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263587.121695:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f2520d/0x1a657bc51395754d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.121702:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016f2520d/0x1a657bc51395754d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.121712:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016f2520d/0x1a657bc51395754d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.121727:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.121728:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.121730:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.122911:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788263587.122921:0:20244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016f2520d/0x1a657bc51395754d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.122952:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.125873:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.125884:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc513957554 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.125901:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.125906:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.125913:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc513957554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.125936:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc513957554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.125946:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc513957554 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.125954:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc513957554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.125979:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788263587.126496:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.126502:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc51395755b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126511:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.126514:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.126518:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc51395755b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126528:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc51395755b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126536:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc51395755b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126551:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc51395755b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126566:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788263587.126583:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788263587.126588:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc513957554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126595:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340030800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.126599:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc513957554 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126608:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc513957554 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126623:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc513957554 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126630:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc513957554 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126648:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.126651:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc51395755b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126668:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340030c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.126671:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc51395755b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126678:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc51395755b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126689:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc51395755b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126695:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc51395755b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.126707:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.126709:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.126710:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.128161:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.130968:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.130983:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc513957562 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131002:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.131006:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.131012:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc513957562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131027:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc513957562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131048:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc513957562 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131057:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc513957562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131080:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.131096:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.131102:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc513957562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131110:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.131114:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc513957562 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131123:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc513957562 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131151:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc513957562 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131158:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc513957562 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131177:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.131184:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.131186:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.131715:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.131722:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a7a3b9f/0x1a657bc513957569 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131731:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.131735:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.131740:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a7a3b9f/0x1a657bc513957569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131749:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a7a3b9f/0x1a657bc513957569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131758:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a7a3b9f/0x1a657bc513957569 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131766:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a7a3b9f/0x1a657bc513957569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.131783:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788263587.137313:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263587.137328:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a7a3b9f/0x1a657bc513957569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.137343:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263587.137348:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a7a3b9f/0x1a657bc513957569 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.137359:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a7a3b9f/0x1a657bc513957569 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.137381:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a7a3b9f/0x1a657bc513957569 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.137389:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a7a3b9f/0x1a657bc513957569 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.137408:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.137410:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.137412:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.138499:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.138510:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc513957570 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.138523:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.138527:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.138533:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc513957570 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.138562:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc513957570 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.138572:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc513957570 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.138579:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc513957570 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.138597:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.138608:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.138612:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc513957570 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.138619:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.138623:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc513957570 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.138630:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc513957570 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.138642:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc513957570 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.138648:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc513957570 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.138672:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.138673:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.138675:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.139200:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.139206:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b789885/0x1a657bc513957577 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139215:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.139244:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.139249:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b789885/0x1a657bc513957577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139259:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b789885/0x1a657bc513957577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139267:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b789885/0x1a657bc513957577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139275:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b789885/0x1a657bc513957577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139288:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788263587.139700:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.139707:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afe4adc3/0x1a657bc51395757e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139726:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.139730:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.139734:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afe4adc3/0x1a657bc51395757e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139745:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afe4adc3/0x1a657bc51395757e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139754:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afe4adc3/0x1a657bc51395757e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139762:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afe4adc3/0x1a657bc51395757e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139779:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788263587.139791:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788263587.139795:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b789885/0x1a657bc513957577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139803:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.139807:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b789885/0x1a657bc513957577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139816:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b789885/0x1a657bc513957577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139843:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b789885/0x1a657bc513957577 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139852:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b789885/0x1a657bc513957577 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139867:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.139871:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afe4adc3/0x1a657bc51395757e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139878:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340030a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.139881:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afe4adc3/0x1a657bc51395757e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139889:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afe4adc3/0x1a657bc51395757e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139899:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afe4adc3/0x1a657bc51395757e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139907:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afe4adc3/0x1a657bc51395757e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.139919:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.139921:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.139927:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.140380:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.145620:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.145634:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ca46d90/0x1a657bc513957585 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.145651:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.145656:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.145662:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ca46d90/0x1a657bc513957585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.145677:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ca46d90/0x1a657bc513957585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.145687:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ca46d90/0x1a657bc513957585 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.145694:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ca46d90/0x1a657bc513957585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.145773:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788263587.146304:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.146311:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013dcef84/0x1a657bc51395758c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.146320:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.146323:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.146327:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013dcef84/0x1a657bc51395758c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.146345:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013dcef84/0x1a657bc51395758c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.146352:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013dcef84/0x1a657bc51395758c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.146359:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013dcef84/0x1a657bc51395758c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.152183:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788263587.152210:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ca46d90/0x1a657bc513957585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.152239:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263587.152244:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ca46d90/0x1a657bc513957585 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.152256:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ca46d90/0x1a657bc513957585 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.152281:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ca46d90/0x1a657bc513957585 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.152288:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ca46d90/0x1a657bc513957585 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.152319:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788263587.152323:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013dcef84/0x1a657bc51395758c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.152328:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340030e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263587.152331:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013dcef84/0x1a657bc51395758c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.152338:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013dcef84/0x1a657bc51395758c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.152359:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013dcef84/0x1a657bc51395758c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.152367:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.152369:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.152372:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788263587.153803:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788263587.159477:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788263587.159494:0:20244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013dcef84/0x1a657bc51395758c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263587.160206:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.160215:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007c3a4f6/0x1a657bc513957593 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160269:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.160274:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.160282:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007c3a4f6/0x1a657bc513957593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160297:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007c3a4f6/0x1a657bc513957593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160320:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007c3a4f6/0x1a657bc513957593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160328:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007c3a4f6/0x1a657bc513957593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160351:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.160363:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.160368:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007c3a4f6/0x1a657bc513957593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160377:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.160381:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007c3a4f6/0x1a657bc513957593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160390:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007c3a4f6/0x1a657bc513957593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160408:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007c3a4f6/0x1a657bc513957593 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160415:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007c3a4f6/0x1a657bc513957593 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160431:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.160439:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.160441:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.160849:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.160856:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000633075c/0x1a657bc51395759a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160865:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.160868:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.160873:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000633075c/0x1a657bc51395759a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160882:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000633075c/0x1a657bc51395759a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160890:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000633075c/0x1a657bc51395759a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160897:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000633075c/0x1a657bc51395759a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160912:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.160921:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.160925:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000633075c/0x1a657bc51395759a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160932:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.160935:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000633075c/0x1a657bc51395759a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160952:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000633075c/0x1a657bc51395759a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160963:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000633075c/0x1a657bc51395759a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160969:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000633075c/0x1a657bc51395759a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.160983:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.160985:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.160986:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.161424:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.161431:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc5139575a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161440:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.161443:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.161447:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc5139575a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161456:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc5139575a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161463:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc5139575a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161476:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc5139575a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161491:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.161500:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.161504:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc5139575a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161510:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.161514:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc5139575a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161521:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc5139575a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161533:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc5139575a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161540:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a31945/0x1a657bc5139575a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161551:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.161553:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.161554:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.161955:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.161969:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc5139575a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161977:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.161981:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.161985:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc5139575a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.161995:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc5139575a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162004:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc5139575a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162010:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc5139575a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162024:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.162032:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.162035:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc5139575a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162042:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.162046:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc5139575a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162054:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc5139575a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162071:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc5139575a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162079:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adaaa025/0x1a657bc5139575a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162093:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.162094:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.162096:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.162523:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.162529:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc5139575af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162538:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.162541:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.162545:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc5139575af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162553:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc5139575af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162561:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc5139575af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162568:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc5139575af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162592:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.162601:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.162604:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc5139575af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162611:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340030c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.162614:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc5139575af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162621:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc5139575af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162632:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc5139575af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162639:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b275d4f8/0x1a657bc5139575af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.162652:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.162653:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.162655:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788263587.163047:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788263587.163053:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc5139575b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.163062:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=613s v=(0 0) 00010000:00010000:2.0:1788263587.163070:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263587.163075:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc5139575b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.163085:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc5139575b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.163093:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc5139575b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.163100:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc5139575b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.163113:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788263587.163121:0:19028:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263587.163125:0:19028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc5139575b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.163323:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263587.168866:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263587.168879:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ee72f99/0x1a657bc5139575bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.168897:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=613s v=(0 0) 00010000:00010000:3.0:1788263587.168902:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263587.168909:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ee72f99/0x1a657bc5139575bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.168922:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ee72f99/0x1a657bc5139575bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.168932:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ee72f99/0x1a657bc5139575bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.168939:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ee72f99/0x1a657bc5139575bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.168970:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263587.169044:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263587.169188:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.169196:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ee72f99/0x1a657bc5139575bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.169205:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159000 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263587.169209:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ee72f99/0x1a657bc5139575bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.169235:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ee72f99/0x1a657bc5139575bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.169263:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ee72f99/0x1a657bc5139575bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.169270:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ee72f99/0x1a657bc5139575bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.169294:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.169296:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.169298:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.169303:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.169305:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263587.169438:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263587.169444:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf547390/0x1a657bc5139575c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.169452:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=613s v=(0 0) 00010000:00010000:3.0:1788263587.169455:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263587.169460:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf547390/0x1a657bc5139575c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.169468:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf547390/0x1a657bc5139575c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.169475:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf547390/0x1a657bc5139575c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.169482:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf547390/0x1a657bc5139575c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.169502:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263587.169565:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263587.169570:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf547390/0x1a657bc5139575c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.169577:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263587.169581:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf547390/0x1a657bc5139575c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.169589:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf547390/0x1a657bc5139575c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.169599:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf547390/0x1a657bc5139575c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.169606:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf547390/0x1a657bc5139575c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.169619:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.169621:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.169622:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263587.169869:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263587.169875:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc5139575cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.169883:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=613s v=(0 0) 00010000:00010000:3.0:1788263587.169886:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263587.169890:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc5139575cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.169910:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc5139575cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.169918:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc5139575cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.169925:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc5139575cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.169947:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263587.170310:0:20740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263587.170320:0:20740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc5139575cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.170328:0:20740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263587.170331:0:20740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc5139575cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.170338:0:20740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc5139575cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.170350:0:20740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc5139575cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.170358:0:20740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000503936c2/0x1a657bc5139575cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788263587.170368:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788263587.170370:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.170371:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.170373:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc670383/0x1a657bc5139575d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.170373:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263587.170381:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=613s v=(0 0) 00010000:00010000:3.0:1788263587.170384:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263587.170388:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc670383/0x1a657bc5139575d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.170398:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc670383/0x1a657bc5139575d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.170405:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc670383/0x1a657bc5139575d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.170423:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc670383/0x1a657bc5139575d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.170442:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263587.170456:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263587.170461:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc670383/0x1a657bc5139575d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.170468:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263587.170471:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc670383/0x1a657bc5139575d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.170488:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc670383/0x1a657bc5139575d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.170500:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc670383/0x1a657bc5139575d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.170507:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc670383/0x1a657bc5139575d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.170518:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.170520:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.170521:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263587.170820:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263587.170826:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f924f1/0x1a657bc5139575d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.170835:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=613s v=(0 0) 00010000:00010000:3.0:1788263587.170838:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263587.170842:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025f924f1/0x1a657bc5139575d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.170851:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025f924f1/0x1a657bc5139575d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.170859:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025f924f1/0x1a657bc5139575d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.170867:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025f924f1/0x1a657bc5139575d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.170889:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263587.171211:0:20740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263587.171233:0:20740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025f924f1/0x1a657bc5139575d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.171240:0:20740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263587.171243:0:20740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f924f1/0x1a657bc5139575d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.171251:0:20740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025f924f1/0x1a657bc5139575d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.171263:0:20740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025f924f1/0x1a657bc5139575d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.171283:0:20740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025f924f1/0x1a657bc5139575d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.171296:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.171298:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.171300:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.171415:0:19028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340030800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263587.171422:0:19028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc5139575b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.171431:0:19028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc5139575b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.171442:0:19028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc5139575b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.171462:0:19028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd53d5bd/0x1a657bc5139575b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263587.171478:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.171480:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263587.171482:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263587.172504:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263587.172517:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b924b07/0x1a657bc5139575e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.172535:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=613s v=(0 0) 00010000:00010000:3.0:1788263587.172538:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263587.172544:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b924b07/0x1a657bc5139575e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.172555:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b924b07/0x1a657bc5139575e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.172564:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b924b07/0x1a657bc5139575e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.172572:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b924b07/0x1a657bc5139575e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.172594:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263587.172710:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263587.172716:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b924b07/0x1a657bc5139575e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.172723:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263587.172727:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b924b07/0x1a657bc5139575e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.172736:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b924b07/0x1a657bc5139575e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.172750:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b924b07/0x1a657bc5139575e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.172757:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b924b07/0x1a657bc5139575e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.172774:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.172776:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.172778:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263587.173021:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263587.173027:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc5139575e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.173036:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=613s v=(0 0) 00010000:00010000:3.0:1788263587.173040:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263587.173044:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc5139575e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.173053:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc5139575e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.173073:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc5139575e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.173080:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc5139575e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.173103:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788263587.173172:0:20740:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263587.173177:0:20740:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc5139575e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.173185:0:20740:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263587.173189:0:20740:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc5139575e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.173197:0:20740:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc5139575e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.173208:0:20740:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc5139575e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.173215:0:20740:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2e576c5/0x1a657bc5139575e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.173247:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.173248:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.173250:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788263587.173539:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263587.173545:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c13f2b52/0x1a657bc5139575ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.173554:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=613s v=(0 0) 00010000:00010000:3.0:1788263587.173558:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263587.173562:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c13f2b52/0x1a657bc5139575ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.173571:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c13f2b52/0x1a657bc5139575ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.173579:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c13f2b52/0x1a657bc5139575ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.173587:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c13f2b52/0x1a657bc5139575ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.173611:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788263587.173993:0:20244:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788263587.173998:0:20244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb87945/0x1a657bc5139575f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.174007:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=613s v=(0 0) 00010000:00010000:3.0:1788263587.174010:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263587.174014:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000abb87945/0x1a657bc5139575f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.174024:0:20244:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000abb87945/0x1a657bc5139575f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.174032:0:20244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000abb87945/0x1a657bc5139575f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.174040:0:20244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000abb87945/0x1a657bc5139575f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263587.174062:0:20244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788263587.174095:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788263587.174101:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c13f2b52/0x1a657bc5139575ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.174108:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263587.174112:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c13f2b52/0x1a657bc5139575ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.174131:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c13f2b52/0x1a657bc5139575ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.174158:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c13f2b52/0x1a657bc5139575ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.174165:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c13f2b52/0x1a657bc5139575ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.174182:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263587.174185:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000abb87945/0x1a657bc5139575f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.174192:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263587.174195:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb87945/0x1a657bc5139575f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.174203:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000abb87945/0x1a657bc5139575f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.174213:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000abb87945/0x1a657bc5139575f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.174241:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000abb87945/0x1a657bc5139575f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263587.174264:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.174266:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263587.174268:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788263587.174677:0:20244:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1788263587.174783:0:20244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:19065:x1875129753794176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 98122us (98217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263587.174793:0:20244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788263587.175057:0:19065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19065:1875129753794176:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788263587.175073:0:19065:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1788263587.175116:0:19065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19065:1875129753794432:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788263587.175160:0:19065:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263587.175202:0:19065:0:(client.c:2715:ptlrpc_set_wait()) set ffff994375e8ab40 going to sleep for 11 seconds 00010000:00010000:2.0:1788263587.177308:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263587.178594:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753794432 00000100:00100000:3.0:1788263587.178615:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753794432 00000100:00100000:3.0:1788263587.178711:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788263587.178722:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:19065:x1875129753794432:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788263587.178767:0:19728:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:3.0:1788263587.189786:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:19065:x1875129753794432:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11057us (14616us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788263587.189801:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788263587.193266:0:19065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:19065:1875129753794432:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788263587.193291:0:19065:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:0.0:1788263587.516298:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788263588.430783:0:20802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788263588.540471:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263589.565713:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263590.587427:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263590.688577:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263590.688693:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735973760 00000100:00100000:2.0:1788263590.688703:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735973760 00000100:00100000:2.0:1788263590.688742:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:2.0:1788263590.688751:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1875129735973760:12345-192.168.201.29@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788263590.688777:0:19035:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 94808cb5-0b27-41af-b9d5-10b2f9721886@192.168.201.29@tcp t0 exp 0000000000000000 cur 617 last 0 00000020:00000080:2.0:1788263590.688801:0:19035:0:(genops.c:1385:class_connect()) connect: client 94808cb5-0b27-41af-b9d5-10b2f9721886, cookie 0x1a657bc5139575fc 00000100:00080000:2.0:1788263590.688927:0:19035:0:(import.c:65:import_set_state_nolock()) ffff994242832800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263590.689002:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+5:2358:x1875129735973760:12345-192.168.201.29@tcp:250:mount.lustre.0 Request processed in 251us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263590.689011:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:1.0:1788263590.702871:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263590.703165:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735973888 00000100:00100000:2.0:1788263590.703177:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735973888 00000100:00100000:2.0:1788263590.703271:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:2.0:1788263590.703282:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+5:16739:x1875129735973888:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788263590.703299:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263590.703319:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340031e00/0x1a657bc513957603 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d357c expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263590.703363:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340031e00/0x1a657bc513957603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d357c expref: 6 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263590.703375:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340031e00/0x1a657bc513957603 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d357c expref: 6 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263590.703385:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340031e00, rc 0) 00000100:00100000:2.0:1788263590.703433:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+6:16739:x1875129735973888:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 154us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263590.703440:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:1.0:1788263590.709359:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263590.709630:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735974016 00000100:00100000:0.0:1788263590.709640:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735974016 00000100:00100000:0.0:1788263590.709699:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:0.0:1788263590.709710:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+6:16739:x1875129735974016:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788263590.710079:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+6:16739:x1875129735974016:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 359us (718us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788263590.710088:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:1.0:1788263590.711631:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263590.711718:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735974144 00000100:00100000:2.0:1788263590.711725:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735974144 00000100:00100000:2.0:1788263590.711770:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:2.0:1788263590.711778:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+6:16739:x1875129735974144:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788263590.711791:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263590.711807:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340031200/0x1a657bc51395760a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3583 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263590.711832:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340031200/0x1a657bc51395760a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3583 expref: 7 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263590.711842:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340031200/0x1a657bc51395760a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3583 expref: 7 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263590.711851:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340031200, rc 0) 00000100:00100000:2.0:1788263590.711898:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a400450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+7:16739:x1875129735974144:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 120us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263590.711919:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:1.0:1788263590.725436:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263590.725628:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735974272 00000100:00100000:0.0:1788263590.725639:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735974272 00000100:00100000:0.0:1788263590.725699:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1788263590.725709:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+7:16739:x1875129735974272:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788263590.725997:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a400850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+8:16739:x1875129735974272:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 289us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263590.726005:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:1.0:1788263590.727468:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263590.727544:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735974400 00000100:00100000:0.0:1788263590.727552:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735974400 00000100:00100000:0.0:1788263590.727604:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:0.0:1788263590.727613:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+8:16739:x1875129735974400:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788263590.727960:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a403050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+8:16739:x1875129735974400:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 347us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263590.727968:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:1.0:1788263590.732323:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263590.732479:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735974528 00000100:00100000:0.0:1788263590.732491:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735974528 00000100:00100000:0.0:1788263590.733040:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:0.0:1788263590.733052:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+8:16757:x1875129735974528:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788263590.733522:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a401c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+8:16757:x1875129735974528:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 470us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263590.733531:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:1.0:1788263590.752520:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263590.754542:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735974656 00000100:00100000:0.0:1788263590.754554:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735974656 00000100:00100000:0.0:1788263590.754626:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:0.0:1788263590.754639:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+8:16757:x1875129735974656:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788263590.754941:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a401850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+8:16757:x1875129735974656:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 304us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263590.754950:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:2.0:1788263590.762410:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263590.762512:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735974784 00000100:00100000:1.0:1788263590.762536:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735974784 00000100:00100000:1.0:1788263590.762601:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:1.0:1788263590.762612:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+8:16739:x1875129735974784:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788263590.762628:0:19033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263590.762645:0:19033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242899000/0x1a657bc513957611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d35ad expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263590.762671:0:19033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242899000/0x1a657bc513957611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35ad expref: 9 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263590.762682:0:19033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242899000/0x1a657bc513957611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35ad expref: 9 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263590.762692:0:19033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899000, rc 0) 00000100:00100000:1.0:1788263590.762748:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a403450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+9:16739:x1875129735974784:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 138us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263590.762755:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:1.0:1788263590.765205:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263590.765457:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735974912 00000100:00100000:2.0:1788263590.765466:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735974912 00000100:00100000:2.0:1788263590.765510:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:2.0:1788263590.765519:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+9:16739:x1875129735974912:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788263590.765542:0:19034:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788263590.765563:0:19034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788263590.765567:0:19034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788263590.765570:0:19034:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788263590.765573:0:19034:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1788263590.773692:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a402c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+9:16739:x1875129735974912:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 8163us (8486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263590.773706:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:3.0:1788263590.776665:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263590.776764:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735975040 00000100:00100000:0.0:1788263590.776772:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735975040 00000100:00100000:0.0:1788263590.776822:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:0.0:1788263590.776832:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+9:16739:x1875129735975040:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788263590.776848:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263590.776864:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216cc00/0x1a657bc513957618 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d35b4 expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263590.776892:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216cc00/0x1a657bc513957618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35b4 expref: 10 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263590.776903:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216cc00/0x1a657bc513957618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35b4 expref: 10 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263590.776912:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216cc00, rc 0) 00000100:00100000:0.0:1788263590.776962:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a401050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+10:16739:x1875129735975040:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 131us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263590.776969:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:1.0:1788263590.786918:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263590.787034:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735975168 00000100:00100000:2.0:1788263590.787043:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735975168 00000100:00100000:2.0:1788263590.787104:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:2.0:1788263590.787114:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+10:16739:x1875129735975168:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788263590.787431:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a400c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+10:16739:x1875129735975168:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 316us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263590.787440:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:3.0:1788263590.796433:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263590.796527:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735975296 00000100:00100000:1.0:1788263590.796535:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735975296 00000100:00100000:1.0:1788263590.796586:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:1.0:1788263590.796594:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+10:16739:x1875129735975296:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788263590.796946:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a402450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+10:16739:x1875129735975296:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 351us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263590.796954:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:3.0:1788263590.804379:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263590.804720:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735975424 00000100:00100000:0.0:1788263590.804730:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735975424 00000100:00100000:0.0:1788263590.804950:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:0.0:1788263590.804963:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+10:16761:x1875129735975424:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788263590.805322:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380186050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+10:16761:x1875129735975424:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 360us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263590.805338:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:0.0:1788263590.816975:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263590.817308:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735975552 00000100:00100000:2.0:1788263590.817317:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735975552 00000100:00100000:2.0:1788263590.817370:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:2.0:1788263590.817380:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+10:16761:x1875129735975552:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263590.817643:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380187c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+10:16761:x1875129735975552:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 263us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263590.817652:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:3.0:1788263590.830261:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263590.830543:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735975680 00000100:00100000:2.0:1788263590.830553:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735975680 00000100:00100000:2.0:1788263590.830615:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788263590.830625:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1875129735975680:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788263590.830657:0:19041:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 42f281e6-4ca9-42e3-af58-12fb1244acb4@192.168.201.29@tcp t0 exp 0000000000000000 cur 617 last 0 00000020:00000080:2.0:1788263590.830712:0:19041:0:(genops.c:1385:class_connect()) connect: client 42f281e6-4ca9-42e3-af58-12fb1244acb4, cookie 0x1a657bc51395761f 00000004:00100000:2.0:1788263590.830742:0:19041:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788263590.830747:0:19041:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1788263590.904614:0:19041:0:(import.c:65:import_set_state_nolock()) ffff99434659a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263590.904708:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:2358:x1875129735975680:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 74081us (74500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263590.904720:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788263590.907299:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263590.907655:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735975808 00000100:00100000:2.0:1788263590.907666:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735975808 00000100:00100000:2.0:1788263590.907746:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1788263590.907758:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:0:x1875129735975808:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788263590.907805:0:19040:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1788263590.908065:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263590.908110:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:0:x1875129735975808:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 353us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263590.908119:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1788263590.916360:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263590.916835:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735975936 00000100:00100000:0.0:1788263590.916846:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735975936 00000100:00100000:0.0:1788263590.916914:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1788263590.916926:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:16739:x1875129735975936:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788263590.916957:0:19041:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788263590.917037:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:16739:x1875129735975936:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 113us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263590.917045:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788263590.922648:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263590.922746:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735976064 00000100:00100000:1.0:1788263590.922769:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735976064 00000100:00100000:1.0:1788263590.922833:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788263590.922852:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:16739:x1875129735976064:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788263590.922955:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:16739:x1875129735976064:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 113us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263590.922963:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788263590.928992:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263590.929033:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263590.929081:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263590.929129:0:19726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735976192 00000100:00100000:0.0:1788263590.929143:0:19726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735976192 00000100:00100000:0.0:1788263590.929190:0:19726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735976320 00000100:00100000:2.0:1788263590.929191:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735976448 00000100:00100000:2.0:1788263590.929194:0:19043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735976448 00000100:00100000:0.0:1788263590.929194:0:19726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735976320 00000100:00100000:0.0:1788263590.929211:0:19726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1788263590.929244:0:19726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875129735976192:12345-192.168.201.29@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788263590.929247:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788263590.929254:0:19043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:16739:x1875129735976448:12345-192.168.201.29@tcp:33:mount.lustre.0 00010000:00080000:0.0:1788263590.929273:0:19726:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 42f281e6-4ca9-42e3-af58-12fb1244acb4@192.168.201.29@tcp t0 exp 0000000000000000 cur 617 last 0 00000020:00000080:0.0:1788263590.929302:0:19726:0:(genops.c:1385:class_connect()) connect: client 42f281e6-4ca9-42e3-af58-12fb1244acb4, cookie 0x1a657bc513957626 00002000:00100000:0.0:1788263590.929312:0:19726:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 42f281e6-4ca9-42e3-af58-12fb1244acb4/ffff994346599800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788263590.929336:0:19726:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788263590.929670:0:19726:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788263590.929699:0:19726:0:(import.c:65:import_set_state_nolock()) ffff994346598000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263590.929758:0:19726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:2358:x1875129735976192:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 538us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263590.929766:0:19726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1788263590.929783:0:19726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788263590.929788:0:19726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1875129735976320:12345-192.168.201.29@tcp:8:mount.lustre.0 00000004:00080000:2.0:1788263590.929804:0:19043:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 494us 00010000:00080000:0.0:1788263590.929804:0:19726:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 42f281e6-4ca9-42e3-af58-12fb1244acb4@192.168.201.29@tcp t0 exp 0000000000000000 cur 617 last 0 00000020:00000080:0.0:1788263590.929822:0:19726:0:(genops.c:1385:class_connect()) connect: client 42f281e6-4ca9-42e3-af58-12fb1244acb4, cookie 0x1a657bc51395762d 00002000:00100000:0.0:1788263590.929829:0:19726:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 42f281e6-4ca9-42e3-af58-12fb1244acb4/ffff99434659e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788263590.929844:0:19726:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788263590.929956:0:19726:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788263590.929972:0:19726:0:(import.c:65:import_set_state_nolock()) ffff99434659b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788263590.929996:0:19726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:2358:x1875129735976320:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 207us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263590.930003:0:19726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000004:00200000:2.0:1788263590.965935:0:19043:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788263590.966139:0:19043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:16739:x1875129735976448:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 36878us (37160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263590.966151:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788263591.144485:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263591.144593:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735976576 00000100:00100000:2.0:1788263591.144603:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735976576 00000100:00100000:2.0:1788263591.144722:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788263591.144734:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:16782:x1875129735976576:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:2.0:1788263591.144754:0:19040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263591.144780:0:19040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340031400/0x1a657bc513957634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d35de expref: -99 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263591.144841:0:19040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994340030a00/0x1a657bc51395763b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263591.144854:0:19040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994340030a00/0x1a657bc51395763b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263591.144867:0:19040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340030a00/0x1a657bc51395763b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263591.144899:0:19040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788263591.144902:0:19040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263591.144933:0:19040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994340030a00/0x1a657bc51395763b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263591.144956:0:19040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340031400/0x1a657bc513957634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35de expref: 8 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263591.144986:0:19040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994340030a00/0x1a657bc51395763b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35de expref: 7 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263591.145009:0:19040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99435656ba00) 00010000:00010000:2.0:1788263591.145012:0:19040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263591.145015:0:19040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340030a00, rc 0) 00000100:00100000:2.0:1788263591.145083:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:16782:x1875129735976576:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 351us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263591.145090:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00010000:00010000:1.0:1788263591.611490:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263592.187513:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3322:1875129753794560:0@lo:400:kworker.0 00000100:00100000:3.0:1788263592.187584:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263592.187640:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753795072:0@lo:400:kworker.0 00000100:00100000:3.0:1788263592.187667:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263592.187691:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788263592.187697:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753794688:0@lo:400:kworker.0 00000100:00100000:3.0:1788263592.187720:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263592.187735:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753795200:0@lo:400:kworker.0 00000100:00100000:3.0:1788263592.187755:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263592.187776:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753795072 00000100:00100000:1.0:1788263592.187782:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753795072 00000100:00100000:3.0:1788263592.187798:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753794816:0@lo:400:kworker.0 00000100:00100000:1.0:1788263592.187831:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753795200 00000100:00100000:1.0:1788263592.187835:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753795200 00000100:00100000:1.0:1788263592.187855:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788263592.187863:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753795072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788263592.187907:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263592.187917:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753795072:12345-0@lo:400:kworker.0 Request processed in 54us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263592.187924:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263592.187925:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753795328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263592.187940:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788263592.187946:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753795200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263592.187974:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753795200:12345-0@lo:400:kworker.0 Request processed in 27us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263592.187980:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788263592.188013:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263592.188129:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753794560 00000100:00100000:2.0:1788263592.188134:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753794560 00000100:00100000:2.0:1788263592.188161:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788263592.188167:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:3322:x1875129753794560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263592.188200:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380184c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:3322:x1875129753794560:12345-0@lo:400:kworker.0 Request processed in 33us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263592.188206:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788263592.188268:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753794944:0@lo:400:kworker.0 00000100:00100000:1.0:1788263592.188313:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753795200:0@lo:400:kworker.0 00000100:00100000:3.0:1788263592.188326:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263592.188553:0:19726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753794688 00000100:00100000:0.0:1788263592.188556:0:19726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753794688 00000100:00100000:0.0:1788263592.188586:0:19726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753794816 00000100:00100000:0.0:1788263592.188588:0:19726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753794816 00000100:00100000:0.0:1788263592.188603:0:19726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788263592.188614:0:19726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753794688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263592.188649:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263592.188673:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99438118ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753795456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788263592.188711:0:19730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753795328 00000100:00100000:2.0:1788263592.188714:0:19730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753795328 00000100:00100000:2.0:1788263592.188735:0:19730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263592.188741:0:19730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3320:x1875129753795328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788263592.188754:0:19730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263592.188797:0:19730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3320:x1875129753795328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263592.188803:0:19730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263592.188844:0:19727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263592.188851:0:19727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3320:x1875129753794816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263592.188879:0:19727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3320:x1875129753794816:12345-0@lo:400:kworker.0 Request processed in 29us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263592.188885:0:19727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788263592.189297:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753794944 00000100:00100000:2.0:1788263592.189302:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753794944 00000100:00100000:2.0:1788263592.189319:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788263592.189325:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753794944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263592.189360:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753794944:12345-0@lo:400:kworker.0 Request processed in 35us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263592.189366:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788263592.190272:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263592.190278:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788263592.191208:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3322:1875129753794560:0@lo:400:kworker.0 00000100:00100000:1.0:1788263592.191246:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753795072:0@lo:400:kworker.0 00000100:00100000:3.0:1788263592.198726:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753795328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788263592.198768:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1875129753794816:0@lo:400:kworker.0 00000100:00100000:1.0:1788263592.198933:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263592.199213:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753794944:0@lo:400:kworker.0 00000100:00100000:0.0:1788263592.199372:0:19726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753794688:12345-0@lo:400:kworker.0 Request processed in 10761us (11649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263592.199384:0:19726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788263592.199472:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753794688:0@lo:400:kworker.0 00000100:00100000:3.0:1788263592.199531:0:19730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753795456 00000100:00100000:3.0:1788263592.199538:0:19730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753795456 00000100:00100000:3.0:1788263592.199588:0:19730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788263592.199597:0:19730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753795456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263592.199620:0:19730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788263592.199673:0:19730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753795456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263592.199680:0:19730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788263592.199751:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99438118ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753795456:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788263592.258355:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 42f281e6-4ca9-42e3-af58-12fb1244acb4 00000001:00100000:2.0:1788263592.268712:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 42f281e6-4ca9-42e3-af58-12fb1244acb4 00000001:00100000:2.0:1788263592.268754:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788263592.268766:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00010000:00010000:2.0:1788263592.635934:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263593.301547:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263593.307174:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735976704 00000100:00100000:2.0:1788263593.307196:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735976704 00000100:00100000:2.0:1788263593.307377:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788263593.307391:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:16834:x1875129735976704:12345-192.168.201.29@tcp:41:lfs.0 00000004:00000024:2.0:1788263593.307451:0:19041:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788263593.307589:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:16834:x1875129735976704:12345-192.168.201.29@tcp:41:lfs.0 Request processed in 200us (6050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263593.307597:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00080000:1.0:1788263593.307693:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263593.317538:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263593.317752:0:19730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735976832 00000100:00100000:2.0:1788263593.317785:0:19730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735976832 00000100:00100000:2.0:1788263593.317945:0:19730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788263593.317957:0:19730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:16834:x1875129735976832:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:2.0:1788263593.318035:0:19730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788263593.318143:0:19730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:16834:x1875129735976832:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 187us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263593.318151:0:19730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00080000:1.0:1788263593.326778:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788263593.330184:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263593.339785:0:19731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735976960 00000100:00100000:2.0:1788263593.339869:0:19731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735976960 00000100:00100000:2.0:1788263593.340244:0:19731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788263593.340256:0:19731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:16834:x1875129735976960:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:2.0:1788263593.340292:0:19731:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788263593.340367:0:19731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:16834:x1875129735976960:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 114us (10193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263593.340375:0:19731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00080000:1.0:1788263593.341166:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788263593.531796:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263593.532002:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735977088 00000100:00100000:1.0:1788263593.532012:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735977088 00000100:00100000:1.0:1788263593.532093:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:1.0:1788263593.532104:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+10:16864:x1875129735977088:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788263593.532120:0:19033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263593.532137:0:19033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242899800/0x1a657bc513957642 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d35e5 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263593.532168:0:19033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242899800/0x1a657bc513957642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35e5 expref: 11 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263593.532180:0:19033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242899800/0x1a657bc513957642 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35e5 expref: 11 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263593.532189:0:19033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899800, rc 0) 00000100:00100000:1.0:1788263593.532283:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380184050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+11:16864:x1875129735977088:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 181us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263593.532290:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:3.0:1788263593.538746:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263593.538955:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735977216 00000100:00100000:2.0:1788263593.538965:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735977216 00000100:00100000:2.0:1788263593.539039:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:2.0:1788263593.539050:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+11:16864:x1875129735977216:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788263593.542381:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380186850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+11:16864:x1875129735977216:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 3321us (3633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263593.542395:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:0.0:1788263593.561062:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263593.561312:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735977344 00000100:00100000:2.0:1788263593.561322:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735977344 00000100:00100000:2.0:1788263593.561379:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:2.0:1788263593.561390:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+11:16864:x1875129735977344:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788263593.562274:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380187850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+11:16864:x1875129735977344:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 880us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263593.562298:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:0.0:1788263593.578054:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263593.578169:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735977472 00000100:00100000:3.0:1788263593.578181:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735977472 00000100:00100000:3.0:1788263593.578264:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:3.0:1788263593.578275:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380185050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+11:16872:x1875129735977472:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263593.578712:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380185050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+11:16872:x1875129735977472:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 436us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263593.578730:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:3.0:1788263593.613542:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263593.613638:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735977600 00000100:00100000:2.0:1788263593.613649:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735977600 00000100:00100000:2.0:1788263593.613709:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:2.0:1788263593.613720:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380185c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+11:16872:x1875129735977600:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263593.614151:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380185c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+11:16872:x1875129735977600:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 431us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263593.614161:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:0.0:1788263593.628794:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263593.628901:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735977728 00000100:00100000:3.0:1788263593.628911:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735977728 00000100:00100000:3.0:1788263593.628982:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:3.0:1788263593.628993:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380186450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+11:16864:x1875129735977728:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788263593.629010:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263593.629065:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343159e00/0x1a657bc513957649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d360f expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263593.629095:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343159e00/0x1a657bc513957649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d360f expref: 12 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263593.629107:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343159e00/0x1a657bc513957649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d360f expref: 12 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263593.629118:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159e00, rc 0) 00000100:00100000:3.0:1788263593.629188:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380186450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+12:16864:x1875129735977728:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 196us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263593.629197:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:0.0:1788263593.643353:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263593.643464:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735977856 00000100:00100000:2.0:1788263593.643475:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735977856 00000100:00100000:2.0:1788263593.643606:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:2.0:1788263593.643618:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+12:16864:x1875129735977856:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788263593.643645:0:19035:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788263593.643667:0:19035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788263593.643671:0:19035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788263593.643675:0:19035:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788263593.643677:0:19035:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00010000:00010000:1.0:1788263593.660343:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263593.661653:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380184450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+12:16864:x1875129735977856:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 18028us (18302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263593.661669:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:0.0:1788263593.669383:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263593.673234:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735977984 00000100:00100000:1.0:1788263593.673251:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735977984 00000100:00100000:1.0:1788263593.673387:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:1.0:1788263593.673399:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+12:16864:x1875129735977984:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788263593.673416:0:19033:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263593.673435:0:19033:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994242898600/0x1a657bc513957650 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3616 expref: -99 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263593.673463:0:19033:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242898600/0x1a657bc513957650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3616 expref: 13 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263593.673473:0:19033:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994242898600/0x1a657bc513957650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3616 expref: 13 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263593.673482:0:19033:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242898600, rc 0) 00000100:00100000:1.0:1788263593.673563:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380185850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16864:x1875129735977984:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 165us (4190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263593.673570:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:1.0:1788263593.685285:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263593.685402:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735978112 00000100:00100000:2.0:1788263593.685412:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735978112 00000100:00100000:2.0:1788263593.685466:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:2.0:1788263593.685476:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16864:x1875129735978112:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788263593.685813:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380187450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16864:x1875129735978112:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 335us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263593.685830:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:0.0:1788263593.692719:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263593.692813:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735978240 00000100:00100000:1.0:1788263593.692823:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735978240 00000100:00100000:1.0:1788263593.692882:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:1.0:1788263593.692893:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16864:x1875129735978240:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788263593.693361:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380186c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16864:x1875129735978240:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 467us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263593.693370:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:2.0:1788263593.696423:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263593.697276:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735978368 00000100:00100000:3.0:1788263593.697287:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735978368 00000100:00100000:3.0:1788263593.697348:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:3.0:1788263593.697359:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16876:x1875129735978368:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788263593.697621:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380187050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16876:x1875129735978368:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 262us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263593.697639:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:3.0:1788263593.717161:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263593.717842:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735978496 00000100:00100000:2.0:1788263593.717853:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735978496 00000100:00100000:2.0:1788263593.717915:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:2.0:1788263593.718292:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16876:x1875129735978496:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788263593.718579:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380184850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16876:x1875129735978496:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 293us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263593.718589:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:0.0:1788263593.738414:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263593.738522:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735978624 00000100:00100000:2.0:1788263593.738533:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735978624 00000100:00100000:2.0:1788263593.738585:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788263593.738593:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1875129735978624:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788263593.738623:0:19040:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 35f00e73-0282-4959-b63a-fcd0dc77029e@192.168.201.29@tcp t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:2.0:1788263593.738665:0:19040:0:(genops.c:1385:class_connect()) connect: client 35f00e73-0282-4959-b63a-fcd0dc77029e, cookie 0x1a657bc513957657 00000004:00100000:2.0:1788263593.738695:0:19040:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788263593.738814:0:19040:0:(import.c:65:import_set_state_nolock()) ffff994356bf2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263593.738904:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f00e73-0282-4959-b63a-fcd0dc77029e+6:2358:x1875129735978624:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 309us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263593.738913:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788263593.756712:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263593.756763:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263593.756959:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735978752 00000100:00100000:0.0:1788263593.756987:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735978752 00000100:00100000:0.0:1788263593.757074:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735978880 00000100:00100000:0.0:1788263593.757078:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735978880 00000100:00100000:0.0:1788263593.757096:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1788263593.757105:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f00e73-0282-4959-b63a-fcd0dc77029e+7:0:x1875129735978752:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788263593.757136:0:19040:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788263593.757199:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f00e73-0282-4959-b63a-fcd0dc77029e+7:0:x1875129735978752:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 95us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263593.757207:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1788263593.757256:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1788263593.757264:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f00e73-0282-4959-b63a-fcd0dc77029e+6:16864:x1875129735978880:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788263593.757275:0:19040:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788263593.757296:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f00e73-0282-4959-b63a-fcd0dc77029e+6:16864:x1875129735978880:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 34us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263593.757303:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00080000:1.0:1788263593.757908:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788263593.762815:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263593.763264:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735979008 00000100:00100000:0.0:1788263593.763287:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735979008 00000100:00100000:0.0:1788263593.763355:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788263593.763366:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f00e73-0282-4959-b63a-fcd0dc77029e+6:16864:x1875129735979008:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788263593.763464:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:35f00e73-0282-4959-b63a-fcd0dc77029e+6:16864:x1875129735979008:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 100us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263593.763471:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788263593.773757:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263593.773802:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263593.773886:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263593.774011:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735979136 00000100:00100000:2.0:1788263593.774030:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735979136 00000100:00100000:2.0:1788263593.774073:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735979264 00000100:00100000:2.0:1788263593.774077:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735979264 00000100:00100000:2.0:1788263593.774095:0:19727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788263593.774104:0:19727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875129735979136:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788263593.774149:0:19727:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 35f00e73-0282-4959-b63a-fcd0dc77029e@192.168.201.29@tcp t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:2.0:1788263593.774185:0:19727:0:(genops.c:1385:class_connect()) connect: client 35f00e73-0282-4959-b63a-fcd0dc77029e, cookie 0x1a657bc51395765e 00002000:00100000:2.0:1788263593.774198:0:19727:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 35f00e73-0282-4959-b63a-fcd0dc77029e/ffff994356bf6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788263593.774210:0:19727:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788263593.774465:0:19727:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788263593.774800:0:19727:0:(import.c:65:import_set_state_nolock()) ffff994356bf4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263593.774866:0:19727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+6:2358:x1875129735979136:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 760us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263593.774875:0:19727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788263593.774898:0:19727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788263593.774903:0:19727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1875129735979264:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788263593.774921:0:19727:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 35f00e73-0282-4959-b63a-fcd0dc77029e@192.168.201.29@tcp t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:2.0:1788263593.774940:0:19727:0:(genops.c:1385:class_connect()) connect: client 35f00e73-0282-4959-b63a-fcd0dc77029e, cookie 0x1a657bc513957665 00002000:00100000:2.0:1788263593.774946:0:19727:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 35f00e73-0282-4959-b63a-fcd0dc77029e/ffff994356bf7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788263593.774953:0:19727:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788263593.775318:0:19727:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788263593.775354:0:19727:0:(import.c:65:import_set_state_nolock()) ffff99437af71000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788263593.775382:0:19727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+6:2358:x1875129735979264:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 477us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263593.775390:0:19727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788263593.775498:0:19044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735979392 00000100:00100000:3.0:1788263593.775504:0:19044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735979392 00000100:00100000:3.0:1788263593.775542:0:19044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1788263593.775549:0:19044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+6:16864:x1875129735979392:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788263593.775611:0:19044:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788263593.775657:0:19044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+6:16864:x1875129735979392:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 108us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263593.775664:0:19044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000040:00080000:0.0:1788263593.915978:0:19070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788263593.936402:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263593.936493:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735979520 00000100:00100000:3.0:1788263593.936504:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735979520 00000100:00100000:3.0:1788263593.936566:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:3.0:1788263593.936576:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+6:16897:x1875129735979520:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:3.0:1788263593.936596:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263593.936620:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158e00/0x1a657bc51395766c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3640 expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263593.936678:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263593.936692:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263593.936721:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263593.936754:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788263593.936758:0:19042:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263593.936779:0:19042:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263593.936802:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158e00/0x1a657bc51395766c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3640 expref: 8 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263593.936820:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3640 expref: 7 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263593.936828:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99435656ba00) 00010000:00010000:3.0:1788263593.936831:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263593.936835:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159200, rc 0) 00000100:00100000:3.0:1788263593.936904:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+7:16897:x1875129735979520:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 329us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263593.936911:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00010000:00010000:1.0:1788263594.683512:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263595.707385:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788263596.330270:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 42f281e6-4ca9-42e3-af58-12fb1244acb4 00000001:00100000:2.0:1788263596.330286:0:5874:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 35f00e73-0282-4959-b63a-fcd0dc77029e 00000001:02000400:0.0:1788263596.596834:0:21003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788263596.734844:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263597.308444:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753795584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263597.308519:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263597.308679:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753795712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263597.308711:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263597.308748:0:19730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753795584 00000100:00100000:3.0:1788263597.308757:0:19730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753795584 00000100:00100000:3.0:1788263597.308814:0:19730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753795712 00000100:00100000:3.0:1788263597.308818:0:19730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753795712 00000100:00100000:3.0:1788263597.308837:0:19730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263597.308847:0:19730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753795584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788263597.308896:0:19730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788263597.308941:0:19730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753795584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263597.308947:0:19730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788263597.308976:0:19730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788263597.308982:0:19730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753795712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263597.309000:0:19730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788263597.309032:0:19730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753795712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263597.309037:0:19730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788263597.309054:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263597.309058:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788263597.309099:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753795712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263597.309597:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753795968:0@lo:400:kworker.0 00000100:00100000:1.0:1788263597.309632:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263597.309656:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788263597.309662:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3321:1875129753795840:0@lo:400:kworker.0 00000100:00100000:1.0:1788263597.309689:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263597.309976:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753795968 00000100:00100000:1.0:1788263597.309982:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753795968 00000100:00100000:1.0:1788263597.310012:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263597.310019:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753795968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263597.310062:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875129753795968:12345-0@lo:400:kworker.0 Request processed in 44us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263597.310069:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263597.310089:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753795840 00000100:00100000:1.0:1788263597.310093:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753795840 00000100:00100000:1.0:1788263597.310113:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788263597.310120:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:3321:x1875129753795840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263597.310147:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380185450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:3321:x1875129753795840:12345-0@lo:400:kworker.0 Request processed in 28us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263597.310152:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788263597.310193:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3321:1875129753795840:0@lo:400:kworker.0 00000100:00100000:1.0:1788263597.310204:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875129753795968:0@lo:400:kworker.0 00000100:00100000:1.0:1788263597.310276:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753796096:0@lo:400:kworker.0 00000100:00100000:1.0:1788263597.310302:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263597.310327:0:3322:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788263597.310342:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753795584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788263597.310352:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788263597.310357:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753796224:0@lo:400:kworker.0 00000100:00100000:1.0:1788263597.310380:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263597.310402:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753796096 00000100:00100000:1.0:1788263597.310406:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753796096 00000100:00100000:1.0:1788263597.310428:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753796224 00000100:00100000:1.0:1788263597.310431:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753796224 00000100:00100000:1.0:1788263597.310445:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788263597.310451:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753796096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263597.310486:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1875129753796096:12345-0@lo:400:kworker.0 Request processed in 35us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263597.310492:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788263597.310504:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263597.310511:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753796224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263597.310536:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1875129753796224:12345-0@lo:400:kworker.0 Request processed in 27us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263597.310542:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788263597.310571:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1875129753796224:0@lo:400:kworker.0 00000100:00100000:1.0:1788263597.310580:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1875129753796096:0@lo:400:kworker.0 00000100:00080000:3.0:1788263597.312313:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1788263597.356880:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 35f00e73-0282-4959-b63a-fcd0dc77029e 00000001:00100000:0.0:1788263597.404789:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 35f00e73-0282-4959-b63a-fcd0dc77029e 00010000:00010000:1.0:1788263597.755454:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788263598.781705:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788263598.822625:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263598.822667:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263598.822698:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263598.822718:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263598.822735:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263598.822751:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263598.822772:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263598.822795:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735980160 00000100:00100000:3.0:1788263598.822804:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735980160 00000100:00100000:3.0:1788263598.822871:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735979776 00000100:00100000:3.0:1788263598.822875:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735979776 00000100:00100000:3.0:1788263598.822906:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1788263598.822916:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+6:2361:x1875129735980160:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263598.822958:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735979648 00000100:00100000:2.0:1788263598.822963:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735979648 00000100:00100000:2.0:1788263598.822992:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 103 00000100:00100000:2.0:1788263598.823001:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+13:2361:x1875129735979648:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263598.823008:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+6:2361:x1875129735980160:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 95us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263598.823017:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1788263598.823028:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+13:2361:x1875129735979648:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263598.823034:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 103 00000100:00100000:3.0:1788263598.823035:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788263598.823040:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:2361:x1875129735979776:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263598.823062:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:2361:x1875129735979776:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263598.823063:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735979904 00000100:00100000:2.0:1788263598.823066:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735979904 00000100:00100000:3.0:1788263598.823068:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788263598.823083:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735980416 00000100:00100000:2.0:1788263598.823083:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735980032 00000100:00100000:3.0:1788263598.823086:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735980416 00000100:00100000:2.0:1788263598.823086:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735980032 00000100:00100000:2.0:1788263598.823097:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735980288 00000100:00100000:2.0:1788263598.823099:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735980288 00000100:00100000:3.0:1788263598.823101:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788263598.823106:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:2361:x1875129735979904:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263598.823111:0:19727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1788263598.823117:0:19727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:2361:x1875129735980032:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263598.823128:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:2361:x1875129735979904:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263598.823134:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788263598.823136:0:19727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:2361:x1875129735980032:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 19us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263598.823142:0:19727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788263598.823146:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788263598.823152:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+5:2361:x1875129735980416:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788263598.823153:0:19727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788263598.823159:0:19727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+5:2361:x1875129735980288:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263598.823172:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+5:2361:x1875129735980416:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 20us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263598.823176:0:19727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+5:2361:x1875129735980288:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 17us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263598.823178:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788263598.823182:0:19727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00080000:3.0:1788263598.823197:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788263598.823200:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788263598.823208:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788263599.811780:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788263600.042294:0:21153:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeabd95e80 20000000:00000080:1.0:1788263600.042318:0:21153:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff994243b4c400 uarg=0000000000000000 20000000:01000000:1.0:1788263600.042354:0:21153:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788263600.042359:0:21153:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788263600.042364:0:21153:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788263600.043139:0:21154:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788263600.043435:0:21153:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788263600.049636:0:21153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788263600.052133:0:21153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052159:0:21153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994343158a00/0x1a657bc513957339 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513957332 expref: 18 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052167:0:21153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994242898800/0x1a657bc513957386 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395737f expref: 18 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052173:0:21153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994380659400/0x1a657bc5139574d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc5139574cf expref: 18 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052183:0:21153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99438216cc00/0x1a657bc513957618 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35b4 expref: 12 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052190:0:21153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff994242898600/0x1a657bc513957650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3616 expref: 12 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052198:0:21153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052270:0:21153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994242898600/0x1a657bc513957650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3616 expref: 12 pid: 19033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052286:0:21153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994242898600/0x1a657bc513957650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3616 expref: 12 pid: 19033 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263600.052317:0:21153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21153:1875129753796352:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263600.052426:0:21153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99438216cc00/0x1a657bc513957618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35b4 expref: 12 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052436:0:21153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99438216cc00/0x1a657bc513957618 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35b4 expref: 12 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263600.052445:0:21153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21153:1875129753796480:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263600.052481:0:21153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994380659400/0x1a657bc5139574d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc5139574cf expref: 18 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052489:0:21153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994380659400/0x1a657bc5139574d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc5139574cf expref: 18 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263600.052498:0:21153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21153:1875129753796608:0@lo:104: 00000100:00100000:1.0:1788263600.052537:0:21153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263600.052568:0:21153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994242898800/0x1a657bc513957386 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc51395737f expref: 18 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052577:0:21153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994242898800/0x1a657bc513957386 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc51395737f expref: 18 pid: 19034 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263600.052585:0:21153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21153:1875129753796736:0@lo:104: 00000100:00100000:1.0:1788263600.052605:0:21153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788263600.052630:0:21153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff994343158a00/0x1a657bc513957339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x1a657bc513957332 expref: 18 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.052637:0:21153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff994343158a00/0x1a657bc513957339 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x1a657bc513957332 expref: 18 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263600.052652:0:21153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21153:1875129753796864:0@lo:104: 00000100:00100000:1.0:1788263600.052678:0:21153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263600.052688:0:21153:0:(client.c:2715:ptlrpc_set_wait()) set ffff994344741000 going to sleep for 11 seconds 00000100:00100000:2.0:1788263600.052775:0:19023:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788263600.052789:0:19023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753796608 00000100:00100000:2.0:1788263600.052796:0:19023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753796608 00000100:00100000:2.0:1788263600.052855:0:19023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753796736 00000100:00100000:2.0:1788263600.052859:0:19023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753796736 00000100:00100000:2.0:1788263600.052870:0:19023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753796864 00000100:00100000:2.0:1788263600.052872:0:19023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753796864 00000100:00100000:2.0:1788263600.052886:0:19023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263600.052895:0:19023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+5:21153:x1875129753796608:12345-0@lo:104: 00010000:00010000:2.0:1788263600.052919:0:19023:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.052977:0:19023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788263600.052984:0:19023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+5:21153:x1875129753796608:12345-0@lo:104: Request processed in 90us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263600.052991:0:19023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263600.053010:0:19023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263600.053016:0:19023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+4:21153:x1875129753796736:12345-0@lo:104: 00010000:00010000:2.0:1788263600.053023:0:19023:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053055:0:19023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788263600.053060:0:19023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+4:21153:x1875129753796736:12345-0@lo:104: Request processed in 44us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263600.053065:0:19023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263600.053077:0:19023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263600.053083:0:19023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f559050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+3:21153:x1875129753796864:12345-0@lo:104: 00010000:00010000:2.0:1788263600.053089:0:19023:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053120:0:19023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788263600.053131:0:19023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f559050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+3:21153:x1875129753796864:12345-0@lo:104: Request processed in 49us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263600.053137:0:19023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788263600.053172:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788263600.053178:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053185:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158400 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263600.053188:0:19029:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053196:0:19029:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263600.053203:0:19029:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263600.053209:0:19029:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788263600.053265:0:19029:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053271:0:19029:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263600.053290:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053297:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343158400/0x1a657bc5139574cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc5139574d6 expref: -99 pid: 20444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053308:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788263600.053311:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053326:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159400 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263600.053329:0:19029:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053336:0:19029:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263600.053342:0:19029:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263600.053347:0:19029:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788263600.053361:0:19029:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053367:0:19029:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263600.053373:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053378:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff994343159400/0x1a657bc51395737f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513957386 expref: -99 pid: 19725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053387:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788263600.053390:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053395:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216c200 already unused, calling callback (ffffffffc1aedc20) 10000000:00010000:2.0:1788263600.053398:0:19029:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053414:0:19029:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788263600.053420:0:19029:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788263600.053425:0:19029:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788263600.053439:0:19029:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053445:0:19029:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788263600.053460:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053466:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff99438216c200/0x1a657bc513957332 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x1a657bc513957339 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053479:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263600.053480:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263600.053482:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263600.053488:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263600.053493:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263600.053510:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3320:1875129753796992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263600.053553:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263600.053581:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788263600.053587:0:3320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3320:1875129753797120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263600.053608:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263600.053634:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3322:1875129753797248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263600.053667:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263600.053699:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753796992 00000100:00100000:2.0:1788263600.053703:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753796992 00010000:00010000:2.0:1788263600.053720:0:19027:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994380659400/0x1a657bc5139574d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139574cf expref: 19 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263600.053735:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753797120 00000100:00100000:2.0:1788263600.053737:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753797120 00010000:00010000:2.0:1788263600.053747:0:19027:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994242898800/0x1a657bc513957386 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395737f expref: 20 pid: 19034 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263600.053757:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753797248 00000100:00100000:2.0:1788263600.053759:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753797248 00010000:00010000:2.0:1788263600.053767:0:19027:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994343158a00/0x1a657bc513957339 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513957332 expref: 21 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263600.053779:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263600.053785:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+21:3320:x1875129753796992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263600.053793:0:19027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263600.053798:0:19027:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994380659400/0x1a657bc5139574d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc5139574cf expref: 21 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053806:0:19027:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994380659400/0x1a657bc5139574d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc5139574cf expref: 21 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053820:0:19027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263600.053848:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+21:3320:x1875129753796992:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263600.053854:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788263600.053868:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263600.053880:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+20:3320:x1875129753797120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263600.053888:0:19027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263600.053892:0:19027:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994242898800/0x1a657bc513957386 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc51395737f expref: 20 pid: 19034 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053900:0:19027:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994242898800/0x1a657bc513957386 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc51395737f expref: 20 pid: 19034 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053921:0:19027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263600.053943:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+20:3320:x1875129753797120:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263600.053948:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788263600.053960:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263600.053966:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fb41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:3322:x1875129753797248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788263600.053973:0:19027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263600.053977:0:19027:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994343158a00/0x1a657bc513957339 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x1a657bc513957332 expref: 19 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053984:0:19027:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994343158a00/0x1a657bc513957339 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x1a657bc513957332 expref: 19 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.053993:0:19027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263600.054018:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fb41850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:3322:x1875129753797248:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263600.054024:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788263600.054079:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3320:1875129753797120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263600.054088:0:3320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3320:1875129753796992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788263600.054114:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3322:1875129753797248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788263600.058077:0:21153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994380659400/0x1a657bc5139574d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc5139574cf expref: 18 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263600.058098:0:21153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21153:1875129753796608:0@lo:104: 00010000:00010000:1.0:1788263600.058112:0:21153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994242898800/0x1a657bc513957386 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc51395737f expref: 17 pid: 19034 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263600.058119:0:21153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21153:1875129753796736:0@lo:104: 00010000:00010000:1.0:1788263600.058128:0:21153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994343158a00/0x1a657bc513957339 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x1a657bc513957332 expref: 16 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263600.058135:0:21153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21153:1875129753796864:0@lo:104: 00000100:00100000:3.0:1788263600.060100:0:21153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21153:1875129753796352:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263600.066946:0:21153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:21153:1875129753796480:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263600.066989:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:3.0:1788263600.067011:0:21153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263600.067026:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263600.067100:0:19026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735980544 00000100:00100000:1.0:1788263600.067107:0:19026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735980544 00000100:00100000:2.0:1788263600.067134:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735980672 00000100:00100000:2.0:1788263600.067138:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735980672 00010000:00010000:1.0:1788263600.067141:0:19026:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff994242898600/0x1a657bc513957650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3616 expref: 13 pid: 19033 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.067153:0:19027:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99438216cc00/0x1a657bc513957618 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35b4 expref: 14 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263600.067245:0:19026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788263600.067256:0:19026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94808cb5-0b27-41af-b9d5-10b2f9721886+14:2362:x1875129735980544:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263600.067271:0:19026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263600.067277:0:19026:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff994242898600/0x1a657bc513957650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3616 expref: 14 pid: 19033 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067288:0:19026:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff994242898600/0x1a657bc513957650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3616 expref: 14 pid: 19033 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067322:0:19026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994242898600/0x1a657bc513957650 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3616 expref: 14 pid: 19033 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067337:0:19026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263600.067389:0:19026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94808cb5-0b27-41af-b9d5-10b2f9721886+13:2362:x1875129735980544:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 134us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263600.067396:0:19026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788263600.067413:0:19026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1788263600.067419:0:19026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94808cb5-0b27-41af-b9d5-10b2f9721886+12:2362:x1875129735980672:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263600.067427:0:19026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263600.067432:0:19026:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99438216cc00/0x1a657bc513957618 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35b4 expref: 12 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067439:0:19026:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99438216cc00/0x1a657bc513957618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35b4 expref: 12 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067449:0:19026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99438216cc00/0x1a657bc513957618 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35b4 expref: 12 pid: 19035 timeout: 726 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067459:0:19026:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067468:0:19026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067481:0:19026:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067508:0:19026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067515:0:19026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067521:0:19026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067527:0:19026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242899a00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263600.067530:0:19026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067537:0:19026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067550:0:19026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263600.067558:0:19026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263600.067577:0:19026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:94808cb5-0b27-41af-b9d5-10b2f9721886+11:2362:x1875129735980672:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 158us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263600.067584:0:19026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00010000:00010000:3.0:1788263600.067598:0:21153:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263600.067606:0:21153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263600.067617:0:21153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff994242899a00/0x1a657bc51395767a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 21153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263600.827417:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788263601.468202:0:19037:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788263601.468210:0:19037:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9943744b8800 from 10 10000000:01000000:2.0:1788263601.468243:0:19037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788263601.468291:0:19037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513957681 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.468304:0:19037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513957681 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.468316:0:19037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513957681 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263601.468341:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753797376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788263601.468416:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263601.468469:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f5c56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263601.469127:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753797376 00000100:00100000:3.0:1788263601.469138:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753797376 00000100:00100000:3.0:1788263601.469192:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788263601.469202:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+16:19037:x1875129753797376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263601.469238:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263601.469254:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343158e00/0x1a657bc513957688 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc513957681 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.469278:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343158e00/0x1a657bc513957688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc513957681 expref: 17 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.469290:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343158e00/0x1a657bc513957688 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc513957681 expref: 17 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.469300:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158e00, rc 0) 00000100:00100000:3.0:1788263601.469372:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:19037:x1875129753797376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263601.469380:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788263601.470173:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753797376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263601.470194:0:19037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513957681 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957688 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.470205:0:19037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513957681 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513957688 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263601.470305:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753797504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263601.470340:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263601.470380:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff994344741000 going to sleep for 11 seconds 00000100:00100000:2.0:1788263601.470438:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753797504 00000100:00100000:2.0:1788263601.470445:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753797504 00000100:00100000:2.0:1788263601.470486:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788263601.470494:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:19037:x1875129753797504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263601.470731:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380288c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:19037:x1875129753797504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263601.470740:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788263601.470971:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753797504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263601.471004:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753797632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263601.471047:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263601.471075:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff994344741000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263601.471188:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753797632 00000100:00100000:0.0:1788263601.471193:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753797632 00000100:00100000:0.0:1788263601.471245:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788263601.471255:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:19037:x1875129753797632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263601.471405:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380288050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:19037:x1875129753797632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263601.471412:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788263601.478628:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753797632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788263601.481708:0:21166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788263601.482023:0:19037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788263601.482059:0:19037:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788263601.482070:0:19037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513957681 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957688 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.482083:0:19037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994340030c00/0x1a657bc513957681 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957688 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788263601.482095:0:19037:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788263601.482097:0:19037:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99437a562800 from 10 10000000:01000000:1.0:1788263601.482100:0:19037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788263601.482136:0:19037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994242898a00/0x1a657bc51395768f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.482144:0:19037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994242898a00/0x1a657bc51395768f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.482155:0:19037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994242898a00/0x1a657bc51395768f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263601.482185:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753797760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788263601.482283:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263601.482328:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff994344741000 going to sleep for 11 seconds 00000100:00100000:3.0:1788263601.482682:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753797760 00000100:00100000:3.0:1788263601.482690:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753797760 00000100:00100000:3.0:1788263601.482731:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788263601.482740:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+17:19037:x1875129753797760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263601.482753:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263601.482767:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994343158600/0x1a657bc513957696 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395768f expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.482788:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994343158600/0x1a657bc513957696 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395768f expref: 18 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.482797:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994343158600/0x1a657bc513957696 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395768f expref: 18 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.482819:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158600, rc 0) 00000100:00100000:3.0:1788263601.482870:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:19037:x1875129753797760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263601.482876:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788263601.483823:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753797760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788263601.483843:0:19037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994242898a00/0x1a657bc51395768f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957696 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.483854:0:19037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994242898a00/0x1a657bc51395768f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc513957696 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263601.483951:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753797888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263601.484008:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263601.484043:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff994344741000 going to sleep for 11 seconds 00000100:00100000:2.0:1788263601.484163:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753797888 00000100:00100000:2.0:1788263601.484168:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753797888 00000100:00100000:2.0:1788263601.484211:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788263601.484247:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:19037:x1875129753797888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788263601.484515:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:19037:x1875129753797888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263601.484523:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788263601.485165:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753797888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263601.485204:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753798016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788263601.485292:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263601.485323:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff994344741000 going to sleep for 11 seconds 00000100:00100000:0.0:1788263601.485384:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753798016 00000100:00100000:0.0:1788263601.485390:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753798016 00000100:00100000:0.0:1788263601.485427:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788263601.485435:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:19037:x1875129753798016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263601.485609:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380289050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:19037:x1875129753798016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263601.485616:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788263601.485704:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753798016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788263601.487443:0:21167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788263601.489789:0:19037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788263601.489841:0:19037:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263601.489853:0:19037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994242898a00/0x1a657bc51395768f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957696 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.489866:0:19037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994242898a00/0x1a657bc51395768f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc513957696 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788263601.489911:0:19037:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788263601.489914:0:19037:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99437fb8c000 from 10 10000000:01000000:3.0:1788263601.489927:0:19037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788263601.489975:0:19037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc51395769d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.489983:0:19037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc51395769d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.489995:0:19037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc51395769d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263601.490021:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347206680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753798144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788263601.490102:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263601.490150:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1788263601.490527:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753798144 00000100:00100000:0.0:1788263601.490536:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753798144 00000100:00100000:0.0:1788263601.490599:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788263601.490611:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+18:19037:x1875129753798144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263601.490626:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263601.490640:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d400/0x1a657bc5139576a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1a657bc51395769d expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.490663:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d400/0x1a657bc5139576a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x1a657bc51395769d expref: 19 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.490674:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d400/0x1a657bc5139576a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x1a657bc51395769d expref: 19 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.490682:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d400, rc 0) 00000100:00100000:0.0:1788263601.490723:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380289c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:19037:x1875129753798144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263601.490730:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788263601.491408:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347206680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753798144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788263601.491425:0:19037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc51395769d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139576a4 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.491435:0:19037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc51395769d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x1a657bc5139576a4 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263601.491490:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347206680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753798272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263601.491526:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263601.491549:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468ad900 going to sleep for 11 seconds 00000100:00100000:1.0:1788263601.491620:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753798272 00000100:00100000:1.0:1788263601.491626:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753798272 00000100:00100000:1.0:1788263601.491651:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788263601.491660:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:19037:x1875129753798272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263601.491941:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:19037:x1875129753798272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263601.491956:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788263601.493339:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347206680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753798272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263601.493385:0:19037:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347206680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753798400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263601.493449:0:19037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263601.493490:0:19037:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943468ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1788263601.493609:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753798400 00000100:00100000:0.0:1788263601.493615:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753798400 00000100:00100000:0.0:1788263601.493664:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788263601.493674:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:19037:x1875129753798400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788263601.493856:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:19037:x1875129753798400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263601.493872:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788263601.494263:0:19037:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347206680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:19037:1875129753798400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788263601.495732:0:21168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788263601.496206:0:19037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788263601.496248:0:19037:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788263601.496258:0:19037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc51395769d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139576a4 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.496269:0:19037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff994343158200/0x1a657bc51395769d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x1a657bc5139576a4 expref: -99 pid: 19037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263601.686154:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263601.686258:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735980800 00000100:00100000:3.0:1788263601.686268:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735980800 00000100:00100000:3.0:1788263601.686338:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1788263601.686350:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:17359:x1875129735980800:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263601.686372:0:19041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263601.686392:0:19041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc5139576ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3647 expref: -99 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686460:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139576b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686474:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139576b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686487:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139576b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686501:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686525:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686532:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686835:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc5139576c0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686844:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc5139576c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686852:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc5139576c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263601.686873:0:19041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788263601.686876:0:19041:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:1.0:1788263601.686903:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1788263601.686924:0:19041:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc5139576c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686936:0:19041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139576b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686943:0:19041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139576b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686949:0:19041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139576b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686955:0:19041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263601.686959:0:19041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139576b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686978:0:19041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139576b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.686991:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99435656ba00) 00010000:00010000:3.0:1788263601.686993:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263601.686997:0:19041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139576b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.687004:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139576b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.687015:0:19041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.687022:0:19041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.687027:0:19041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.687032:0:19041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263601.687034:0:19041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.687039:0:19041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.687045:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9943564fb200) 00010000:00010000:3.0:1788263601.687048:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263601.687050:0:19041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.687065:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.687097:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc5139576ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3647 expref: 8 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.687110:0:19041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159c00/0x1a657bc5139576c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3647 expref: 7 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.687117:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9943564fb500) 00010000:00010000:3.0:1788263601.687119:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263601.687122:0:19041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159c00, rc 0) 00000100:00100000:3.0:1788263601.687183:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:17359:x1875129735980800:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 836us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263601.687191:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1788263601.694673:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263601.695899:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735981056 00000100:00100000:0.0:1788263601.695914:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735981056 00000100:00100000:0.0:1788263601.695993:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788263601.696005:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:17359:x1875129735981056:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263601.696028:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263601.696052:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc5139576c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d364e expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.696133:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139576ce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.696148:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139576ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.696161:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139576ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.696178:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139576d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.696312:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139576d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.696322:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139576d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.696674:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c200/0x1a657bc5139576dc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.696694:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c200/0x1a657bc5139576dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.696702:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c200/0x1a657bc5139576dc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263601.696714:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788263601.697672:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139576ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.697685:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139576ce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.697693:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139576ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.697699:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ca00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263601.697704:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139576ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.697713:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139576ce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.699289:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9943564fb500) 00010000:00010000:0.0:1788263601.699297:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263601.699304:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139576ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.699312:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc5139576ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.699330:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139576d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.699349:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139576d5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.699804:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139576d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.699811:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263601.699814:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139576d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.699822:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139576d5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.699833:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9942419f8600) 00010000:00010000:0.0:1788263601.699836:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263601.699839:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139576d5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.699846:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139576d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.704250:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc5139576c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d364e expref: 10 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.704281:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c200/0x1a657bc5139576dc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d364e expref: 9 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.704291:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9942419f8b00) 00010000:00010000:0.0:1788263601.704295:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263601.704306:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216c200, rc 0) 00000100:00100000:0.0:1788263601.704395:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+9:17359:x1875129735981056:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 8390us (9730us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788263601.704405:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1788263601.709643:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263601.709723:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735981184 00000100:00100000:0.0:1788263601.709732:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735981184 00000100:00100000:0.0:1788263601.709793:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:0.0:1788263601.709804:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+11:16753:x1875129735981184:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788263601.709822:0:19034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263601.709840:0:19034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99438216d000/0x1a657bc5139576ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3655 expref: -99 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.709868:0:19034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99438216d000/0x1a657bc5139576ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3655 expref: 12 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.709907:0:19034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99438216d000/0x1a657bc5139576ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3655 expref: 12 pid: 19034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.709918:0:19034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216d000, rc 0) 00000100:00100000:0.0:1788263601.709989:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+12:16753:x1875129735981184:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 186us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263601.709996:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:2.0:1788263601.727213:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263601.727359:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735981312 00000100:00100000:3.0:1788263601.727373:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735981312 00000100:00100000:3.0:1788263601.727455:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1788263601.727469:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+9:17359:x1875129735981312:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788263601.727615:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+9:17359:x1875129735981312:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 148us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263601.727624:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1788263601.740469:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263601.740585:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735981440 00000100:00100000:1.0:1788263601.740598:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735981440 00000100:00100000:1.0:1788263601.740668:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:1.0:1788263601.740681:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+12:16753:x1875129735981440:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788263601.741096:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+12:16753:x1875129735981440:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 416us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263601.741107:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:0.0:1788263601.746954:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263601.754192:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735981568 00000100:00100000:3.0:1788263601.754214:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735981568 00000100:00100000:3.0:1788263601.756427:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:3.0:1788263601.756441:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+12:16753:x1875129735981568:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788263601.756744:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+12:16753:x1875129735981568:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 304us (9804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263601.756754:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:3.0:1788263601.771387:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263601.771506:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735981696 00000100:00100000:2.0:1788263601.771520:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735981696 00000100:00100000:2.0:1788263601.771592:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:2.0:1788263601.771605:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438028b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+12:16753:x1875129735981696:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788263601.771628:0:19035:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263601.771653:0:19035:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff994340031600/0x1a657bc5139576f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3957daceab5d365c expref: -99 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.771689:0:19035:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff994340031600/0x1a657bc5139576f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d365c expref: 13 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.771702:0:19035:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff994340031600/0x1a657bc5139576f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d365c expref: 13 pid: 19035 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.771713:0:19035:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340031600, rc 0) 00000100:00100000:2.0:1788263601.771785:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438028b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16753:x1875129735981696:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 176us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263601.771793:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:0.0:1788263601.780734:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263601.785990:0:19034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735981824 00000100:00100000:3.0:1788263601.786018:0:19034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735981824 00000100:00100000:3.0:1788263601.786105:0:19034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:3.0:1788263601.786116:0:19034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16753:x1875129735981824:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788263601.786493:0:19034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380288850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16753:x1875129735981824:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 377us (5773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263601.786502:0:19034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:0.0:1788263601.797637:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263601.799539:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735981952 00000100:00100000:1.0:1788263601.799562:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735981952 00000100:00100000:1.0:1788263601.799655:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:1.0:1788263601.799668:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994380289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16753:x1875129735981952:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788263601.802363:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994380289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+13:16753:x1875129735981952:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 2678us (4724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263601.802399:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:0.0:1788263601.826645:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263601.826746:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735982080 00000100:00100000:3.0:1788263601.826761:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735982080 00000100:00100000:3.0:1788263601.826836:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788263601.826848:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+9:17366:x1875129735982080:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263601.826875:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263601.826917:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc5139576f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3663 expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827014:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827032:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827067:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827085:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957706 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827093:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827100:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827409:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827417:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827424:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827430:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263601.827435:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827443:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827458:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99435656ba00) 00010000:00010000:3.0:1788263601.827461:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263601.827467:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827480:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc5139576ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827497:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827503:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957706 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827509:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827515:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263601.827518:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827524:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957706 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827533:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9943564fb200) 00010000:00010000:3.0:1788263601.827536:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263601.827539:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957706 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827545:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957706 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827584:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc5139576f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3663 expref: 10 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827609:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99435656ba00) 00010000:00010000:3.0:1788263601.827612:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788263601.827616:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc5139576f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3663 expref: 10 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.827628:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158c00, rc 0) 00000100:00100000:3.0:1788263601.827707:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+9:17366:x1875129735982080:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 859us (1078us total) trans 0 rc 301/301 00000100:00100000:3.0:1788263601.827716:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788263601.835597:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263601.836312:0:19049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735982208 00000100:00100000:3.0:1788263601.836328:0:19049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735982208 00000100:00100000:3.0:1788263601.836404:0:19049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788263601.836417:0:19049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:42f281e6-4ca9-42e3-af58-12fb1244acb4+9:17366:x1875129735982208:12345-192.168.201.29@tcp:700:lfs.0 00000100:00100000:3.0:1788263601.836526:0:19049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:42f281e6-4ca9-42e3-af58-12fb1244acb4+9:17366:x1875129735982208:12345-192.168.201.29@tcp:700:lfs.0 Request processed in 111us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263601.836535:0:19049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788263601.839158:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263601.839338:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735982464 00000100:00100000:1.0:1788263601.839351:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735982464 00000100:00100000:1.0:1788263601.839423:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1788263601.839436:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+9:17366:x1875129735982464:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:1.0:1788263601.839511:0:19041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263601.839548:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340030a00/0x1a657bc51395763b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d35de expref: 9 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.839575:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99435656ba00) 00010000:00010000:1.0:1788263601.839581:0:19041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263601.839850:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.839866:0:19041:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3640 expref: 5 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.842258:0:19041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.842351:0:19041:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3640 expref: 5 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.842373:0:19041:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3640 expref: 5 pid: 19042 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263601.842394:0:19041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:19041:1875129753798528:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788263601.842532:0:19041:0:(client.c:2715:ptlrpc_set_wait()) set ffff994344741000 going to sleep for 11 seconds 00000100:00100000:1.0:1788263601.848794:0:19041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bf9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:19041:1875129753798528:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788263601.848834:0:19041:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.851401:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788263601.855126:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263601.855465:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735982592 00000100:00100000:2.0:1788263601.855478:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735982592 00010000:00010000:2.0:1788263601.855560:0:19027:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3640 expref: 6 pid: 19042 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263601.855610:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788263601.855624:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+6:2362:x1875129735982592:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263601.855642:0:19027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263601.855650:0:19027:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3640 expref: 6 pid: 19042 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.855667:0:19027:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3640 expref: 6 pid: 19042 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.855696:0:19027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957673 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3640 expref: 6 pid: 19042 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.855718:0:19027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99435656ba00) 00010000:00010000:2.0:1788263601.855724:0:19027:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.855735:0:19027:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.855744:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.855811:0:19027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263601.855896:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+5:2362:x1875129735982592:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 275us (786us total) trans 0 rc 0/0 00000100:00080000:1.0:1788263601.855985:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263601.856027:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00010000:00010000:3.0:1788263601.856575:0:19041:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.856588:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.856623:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513957714 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.856636:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513957714 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.856655:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513957714 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263601.858986:0:19041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788263601.859017:0:19041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.859031:0:19041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.859040:0:19041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.859048:0:19041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242899c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263601.859055:0:19041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.859064:0:19041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.859087:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99435656ba00) 00010000:00010000:2.0:1788263601.859090:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263601.859096:0:19041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.859103:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899c00/0x1a657bc51395770d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263601.859134:0:19041:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079794bfd reply state 0000000040847481 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513957714 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263601.859155:0:19041:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788263601.859492:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+10:17366:x1875129735982464:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 20051us (20340us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788263601.859504:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:1.0:1788263601.862150:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513957714 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.862183:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513957714 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.862193:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513957714 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.862521:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263601.862527:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513957714 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.862535:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513957714 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.862557:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9943564fb200) 00010000:00010000:1.0:1788263601.862560:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263601.862565:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513957714 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263601.862573:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc513957714 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263601.954543:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263601.954994:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735982720 00000100:00100000:3.0:1788263601.955009:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735982720 00000100:00100000:3.0:1788263601.955100:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:3.0:1788263601.955114:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+9:17375:x1875129735982720:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:3.0:1788263601.955148:0:19040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263601.955180:0:19040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc51395771b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d366a expref: -99 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.955459:0:19040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957722 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.955478:0:19040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957722 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.955491:0:19040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957722 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263601.955538:0:19040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788263601.955542:0:19040:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263601.955690:0:19040:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957722 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.955723:0:19040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc51395771b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d366a expref: 11 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.955745:0:19040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158800/0x1a657bc513957722 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d366a expref: 10 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263601.955762:0:19040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943564fb800) 00010000:00010000:3.0:1788263601.955765:0:19040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263601.955770:0:19040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158800, rc 0) 00000100:00100000:3.0:1788263601.955985:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+10:17375:x1875129735982720:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 872us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263601.955993:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788263601.980458:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263601.980614:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735982848 00000100:00100000:2.0:1788263601.980629:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735982848 00000100:00100000:2.0:1788263601.980707:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1788263601.980721:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+5:17376:x1875129735982848:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263601.980748:0:19041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263601.980775:0:19041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc513957729 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3671 expref: -99 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.980870:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994340030a00/0x1a657bc513957730 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.980899:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994340030a00/0x1a657bc513957730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.980912:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340030a00/0x1a657bc513957730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263601.980959:0:19041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788263601.980963:0:19041:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263601.980986:0:19041:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994340030a00/0x1a657bc513957730 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.981015:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc513957729 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3671 expref: 7 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.981061:0:19041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994340030a00/0x1a657bc513957730 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3671 expref: 6 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263601.981072:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943564fb800) 00010000:00010000:2.0:1788263601.981076:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788263601.981080:0:19041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340030a00, rc 0) 00000100:00100000:2.0:1788263601.981612:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+6:17376:x1875129735982848:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 891us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263601.981622:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788263601.998364:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263601.998482:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735982976 00000100:00100000:0.0:1788263601.998495:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735982976 00000100:00100000:0.0:1788263601.998581:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1788263601.998596:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+6:17376:x1875129735982976:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788263601.998624:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263601.998651:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957737 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3678 expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.998728:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc51395773e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.998744:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc51395773e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.998757:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc51395773e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.998774:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513957745 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.998791:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513957745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.998797:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513957745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.998917:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395774c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.998946:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395774c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.998955:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395774c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263601.999005:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788263601.999010:0:19042:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263601.999035:0:19042:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395774c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999049:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc51395773e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999056:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc51395773e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999063:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc51395773e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999070:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216c600 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263601.999075:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc51395773e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999083:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc51395773e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999098:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943564fb800) 00010000:00010000:0.0:1788263601.999101:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263601.999108:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc51395773e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999125:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c600/0x1a657bc51395773e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999315:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513957745 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999321:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513957745 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999327:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513957745 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999332:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ca00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263601.999335:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513957745 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999341:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513957745 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999349:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9942419f8600) 00010000:00010000:0.0:1788263601.999351:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788263601.999354:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513957745 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999360:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ca00/0x1a657bc513957745 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999396:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957737 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3678 expref: 8 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999424:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395774c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3678 expref: 7 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263601.999432:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9942419f8400) 00010000:00010000:0.0:1788263601.999434:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788263601.999436:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216de00, rc 0) 00000100:00100000:0.0:1788263601.999631:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+7:17376:x1875129735982976:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1037us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263601.999639:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1788263602.003548:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263602.003749:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735983232 00000100:00100000:2.0:1788263602.003762:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735983232 00000100:00100000:2.0:1788263602.003995:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788263602.004008:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+7:17376:x1875129735983232:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263602.004038:0:19041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263602.004066:0:19041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc513957753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d367f expref: -99 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263602.004203:0:19041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788263602.004420:0:19041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc513957753 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d367f expref: 9 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.004439:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943564fb800) 00010000:00010000:2.0:1788263602.004443:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263602.004449:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc513957753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d367f expref: 9 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.004488:0:19041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340031000, rc 0) 00000100:00100000:2.0:1788263602.004562:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+8:17376:x1875129735983232:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 556us (1342us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788263602.004584:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:1.0:1788263602.016699:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263602.016961:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735983488 00000100:00100000:0.0:1788263602.016975:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735983488 00000100:00100000:0.0:1788263602.017058:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:0.0:1788263602.017071:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+8:17376:x1875129735983488:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:0.0:1788263602.017164:0:19042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263602.017199:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc51395774c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3678 expref: 8 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.017263:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9942419f8400) 00010000:00010000:0.0:1788263602.017276:0:19042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788263602.017307:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957761 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.017322:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957761 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.017334:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957761 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263602.017638:0:19042:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004018038c reply state 00000000033a5516 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957761 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263602.017650:0:19042:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788263602.017659:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788263602.018431:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+9:17376:x1875129735983488:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 1356us (1742us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788263602.018444:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00010000:00010000:2.0:1788263602.033516:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957761 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.033542:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957761 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.033552:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957761 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.033560:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216cc00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263602.033565:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957761 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.033575:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957761 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.033598:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9942419f8600) 00010000:00010000:2.0:1788263602.033601:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788263602.033607:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957761 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.033614:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc513957761 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263602.036428:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263602.036610:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735983744 00000100:00100000:2.0:1788263602.036648:0:19043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735983744 00000100:00100000:2.0:1788263602.036720:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788263602.036732:0:19043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f00e73-0282-4959-b63a-fcd0dc77029e+8:17376:x1875129735983744:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263602.037072:0:19043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f00e73-0282-4959-b63a-fcd0dc77029e+9:17376:x1875129735983744:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 340us (657us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788263602.037082:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1788263602.042821:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263602.045127:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735984000 00000100:00100000:2.0:1788263602.045148:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735984000 00000100:00100000:2.0:1788263602.045305:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:2.0:1788263602.045321:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+9:17376:x1875129735984000:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263602.045359:0:19041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263602.045387:0:19041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340030800/0x1a657bc513957768 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3686 expref: -99 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045485:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc51395776f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045503:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc51395776f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045516:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc51395776f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045532:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957776 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045539:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045546:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263602.045718:0:19041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788263602.045841:0:19041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc51395776f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045849:0:19041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc51395776f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045856:0:19041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc51395776f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045862:0:19041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263602.045867:0:19041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc51395776f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045890:0:19041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc51395776f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045904:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943564fb800) 00010000:00010000:2.0:1788263602.045908:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263602.045913:0:19041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc51395776f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045919:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc51395776f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045936:0:19041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045942:0:19041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957776 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045960:0:19041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957776 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045965:0:19041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263602.045968:0:19041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957776 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045974:0:19041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957776 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045981:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99435656ba00) 00010000:00010000:2.0:1788263602.045983:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263602.045986:0:19041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957776 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.045993:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957776 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.046039:0:19041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994340030800/0x1a657bc513957768 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3686 expref: 11 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.046051:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943564fb800) 00010000:00010000:2.0:1788263602.046053:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263602.046056:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340030800/0x1a657bc513957768 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3686 expref: 11 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.046068:0:19041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340030800, rc 0) 00000100:00100000:2.0:1788263602.046161:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+10:17376:x1875129735984000:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 844us (3349us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788263602.046179:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1788263602.050722:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.050947:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735984128 00000100:00100000:3.0:1788263602.050961:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735984128 00000100:00100000:3.0:1788263602.051032:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:3.0:1788263602.051059:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+10:17376:x1875129735984128:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788263602.051091:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263602.051121:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957784 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d368d expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.051267:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.051284:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.051298:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263602.051328:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788263602.051332:0:19042:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263602.051356:0:19042:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.051410:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957784 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d368d expref: 12 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.051433:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d368d expref: 11 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.051443:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9943564fbd00) 00010000:00010000:3.0:1788263602.051446:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788263602.051451:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159000, rc 0) 00000100:00100000:3.0:1788263602.051527:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+11:17376:x1875129735984128:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 471us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263602.051536:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1788263602.061154:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.061376:0:19044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735984256 00000100:00100000:3.0:1788263602.061389:0:19044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735984256 00000100:00100000:3.0:1788263602.061459:0:19044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1788263602.061472:0:19044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+11:17376:x1875129735984256:12345-192.168.201.29@tcp:37:lfs.0 00000100:00100000:3.0:1788263602.066820:0:19044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+11:17376:x1875129735984256:12345-192.168.201.29@tcp:37:lfs.0 Request processed in 5339us (5668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263602.066835:0:19044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:0.0:1788263602.077083:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263602.077324:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735984512 00000100:00100000:2.0:1788263602.077341:0:19043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735984512 00000100:00100000:2.0:1788263602.077430:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788263602.077445:0:19043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994372195050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f00e73-0282-4959-b63a-fcd0dc77029e+11:17376:x1875129735984512:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788263602.077774:0:19043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994372195050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:35f00e73-0282-4959-b63a-fcd0dc77029e+12:17376:x1875129735984512:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 332us (700us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788263602.077783:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000040:00080000:0.0:1788263602.108575:0:19070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788263602.158539:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263602.158655:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735984640 00000100:00100000:2.0:1788263602.158667:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735984640 00000100:00100000:2.0:1788263602.158740:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:2.0:1788263602.158751:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+10:17382:x1875129735984640:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788263602.158784:0:19041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263602.158805:0:19041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340030800/0x1a657bc513957792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d3694 expref: -99 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.158867:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957799 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.158893:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.158903:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.158919:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc5139577a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.158944:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc5139577a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.158952:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc5139577a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159047:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994340030e00/0x1a657bc5139577a7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159055:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994340030e00/0x1a657bc5139577a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159062:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340030e00/0x1a657bc5139577a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263602.159091:0:19041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788263602.159095:0:19041:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263602.159134:0:19041:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994340030e00/0x1a657bc5139577a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159146:0:19041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159152:0:19041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957799 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159159:0:19041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957799 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159165:0:19041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263602.159169:0:19041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957799 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159184:0:19041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957799 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159197:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943564fb800) 00010000:00010000:2.0:1788263602.159200:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263602.159204:0:19041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957799 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159210:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340031a00/0x1a657bc513957799 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159272:0:19041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc5139577a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159279:0:19041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc5139577a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159285:0:19041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc5139577a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159290:0:19041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263602.159293:0:19041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc5139577a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159298:0:19041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc5139577a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159305:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99435656ba00) 00010000:00010000:2.0:1788263602.159308:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263602.159310:0:19041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc5139577a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159326:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340031800/0x1a657bc5139577a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159360:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340030800/0x1a657bc513957792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3694 expref: 12 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159374:0:19041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994340030e00/0x1a657bc5139577a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d3694 expref: 11 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.159382:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9943564fbd00) 00010000:00010000:2.0:1788263602.159384:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788263602.159387:0:19041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994340030e00, rc 0) 00000100:00100000:2.0:1788263602.159441:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+11:17382:x1875129735984640:12345-192.168.201.29@tcp:101:bash.0 Request processed in 691us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263602.159448:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:0.0:1788263602.164321:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263602.164407:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735984896 00000100:00100000:2.0:1788263602.164416:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735984896 00000100:00100000:2.0:1788263602.164466:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:2.0:1788263602.164476:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+11:17382:x1875129735984896:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788263602.164499:0:19040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263602.164521:0:19040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340031400/0x1a657bc5139577ae lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d369b expref: -99 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.164640:0:19040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.164654:0:19040:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d368d expref: 11 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.164675:0:19040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.164710:0:19040:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d368d expref: 11 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.164739:0:19040:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d368d expref: 11 pid: 19042 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263602.164753:0:19040:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:19040:1875129753798656:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263602.164855:0:19040:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437f5c5a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263602.167831:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263602.168012:0:19026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735985024 00000100:00100000:1.0:1788263602.168022:0:19026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735985024 00010000:00010000:1.0:1788263602.168064:0:19026:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d368d expref: 12 pid: 19042 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263602.168110:0:19026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1788263602.168121:0:19026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+12:2361:x1875129735985024:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263602.168150:0:19026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263602.168157:0:19026:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d368d expref: 12 pid: 19042 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.168169:0:19026:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d368d expref: 12 pid: 19042 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.168190:0:19026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9943564fbd00) 00010000:00010000:1.0:1788263602.168195:0:19026:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.168204:0:19026:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.168212:0:19026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.168248:0:19026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788263602.168302:0:19026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+12:2361:x1875129735985024:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 183us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263602.168310:0:19026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00010000:00010000:2.0:1788263602.169122:0:19040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc51395778b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d368d expref: 11 pid: 19042 timeout: 728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263602.169141:0:19040:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7b8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:19040:1875129753798656:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263602.169163:0:19040:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.169172:0:19040:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.169178:0:19040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.169235:0:19040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100a00/0x1a657bc5139577bc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.169247:0:19040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994376100a00/0x1a657bc5139577bc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.169262:0:19040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994376100a00/0x1a657bc5139577bc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.170441:0:19040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994376101000/0x1a657bc5139577c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.170456:0:19040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994376101000/0x1a657bc5139577c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.170464:0:19040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994376101000/0x1a657bc5139577c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263602.170475:0:19040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788263602.170501:0:19040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.170508:0:19040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.170514:0:19040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.170519:0:19040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994340031000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263602.170523:0:19040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.170529:0:19040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.170539:0:19040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9943564fbd00) 00010000:00010000:2.0:1788263602.170542:0:19040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263602.170552:0:19040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.170559:0:19040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340031000/0x1a657bc5139577b5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788263602.170571:0:19040:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099cf09aa reply state 0000000074eca362 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff994376100a00/0x1a657bc5139577bc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263602.170580:0:19040:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788263602.170615:0:19040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994340031400/0x1a657bc5139577ae lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d369b expref: 14 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.170630:0:19040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994376101000/0x1a657bc5139577c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d369b expref: 13 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.170636:0:19040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:2.0:1788263602.170638:0:19040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788263602.170640:0:19040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994376101000, rc 0) 00000100:00100000:2.0:1788263602.170713:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+14:17382:x1875129735984896:12345-192.168.201.29@tcp:101:bash.0 Request processed in 6238us (6401us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788263602.176092:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00010000:00010000:1.0:1788263602.184993:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100a00/0x1a657bc5139577bc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.185012:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994376100a00/0x1a657bc5139577bc lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.185019:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994376100a00/0x1a657bc5139577bc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.185044:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994376100a00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263602.185049:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100a00/0x1a657bc5139577bc lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.185057:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100a00/0x1a657bc5139577bc lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.185073:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99435656b400) 00010000:00010000:1.0:1788263602.185076:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788263602.185080:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994376100a00/0x1a657bc5139577bc lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.185087:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994376100a00/0x1a657bc5139577bc lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263602.190801:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.191269:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735985152 00000100:00100000:3.0:1788263602.191281:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735985152 00000100:00100000:3.0:1788263602.191338:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:3.0:1788263602.191349:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+13:17382:x1875129735985152:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788263602.191374:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263602.191396:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139577d1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36a2 expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.191481:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.191496:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.191508:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263602.191547:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788263602.191552:0:19042:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788263602.191575:0:19042:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.191586:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.191610:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc5139577d1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36a2 expref: 15 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.191629:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36a2 expref: 14 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.191638:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:3.0:1788263602.191640:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788263602.191644:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159000, rc 0) 00000100:00100000:3.0:1788263602.191711:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+14:17382:x1875129735985152:12345-192.168.201.29@tcp:101:bash.0 Request processed in 363us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263602.191718:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:0.0:1788263602.205983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.206080:0:19044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735985408 00000100:00100000:3.0:1788263602.206090:0:19044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735985408 00000100:00100000:3.0:1788263602.206155:0:19044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788263602.206166:0:19044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+14:17382:x1875129735985408:12345-192.168.201.29@tcp:35:bash.0 00000001:00080000:3.0:1788263602.206482:0:19044:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:3.0:1788263602.206588:0:19044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+16:17382:x1875129735985408:12345-192.168.201.29@tcp:35:bash.0 Request processed in 420us (611us total) trans 12884901898 rc 0/0 00000100:00100000:3.0:1788263602.206596:0:19044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000020:00080000:3.0:1788263602.206600:0:19044:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788263602.299317:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263602.301290:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735985664 00000100:00100000:2.0:1788263602.301304:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735985664 00000100:00100000:2.0:1788263602.301497:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:2.0:1788263602.301508:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+16:17392:x1875129735985664:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788263602.301536:0:19040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263602.301557:0:19040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc5139577df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36a9 expref: -99 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263602.301674:0:19040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788263602.301791:0:19040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc5139577df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36a9 expref: 18 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.301806:0:19040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9943564fb800) 00010000:00010000:2.0:1788263602.301808:0:19040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263602.301814:0:19040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc5139577df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36a9 expref: 18 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.301828:0:19040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994376100e00, rc 0) 00000100:00100000:2.0:1788263602.301976:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+17:17392:x1875129735985664:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 400us (2598us total) trans 12884901899 rc 301/301 00000100:00100000:2.0:1788263602.301986:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:0.0:1788263602.305463:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.305821:0:19044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735985920 00000100:00100000:3.0:1788263602.305832:0:19044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735985920 00000100:00100000:0.0:1788263602.308126:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1788263602.308152:0:19043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+17:17392:x1875129735985920:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788263602.308429:0:19043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+18:17392:x1875129735985920:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 290us (2975us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788263602.308439:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:0.0:1788263602.375850:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263602.375956:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735986176 00000100:00100000:1.0:1788263602.375966:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735986176 00000100:00100000:1.0:1788263602.376032:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:1.0:1788263602.376044:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+18:17395:x1875129735986176:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788263602.376079:0:19041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263602.376101:0:19041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139577ed lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36b0 expref: -99 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.376204:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139577f4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.376244:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139577f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.376274:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139577f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263602.376288:0:19041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788263602.376405:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139577ed lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36b0 expref: 21 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.376424:0:19041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139577f4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36b0 expref: 20 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.376434:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:1.0:1788263602.376437:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263602.376440:0:19041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899200, rc 0) 00000100:00100000:1.0:1788263602.376501:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+20:17395:x1875129735986176:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 461us (659us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788263602.376509:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:0.0:1788263602.381798:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263602.383547:0:19025:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735986304 00000100:00100000:2.0:1788263602.383560:0:19025:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735986304 00000100:00100000:2.0:1788263602.383640:0:19025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788263602.383651:0:19025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943473dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+20:2361:x1875129735986304:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263602.383667:0:19025:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263602.383696:0:19025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139577f4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36b0 expref: 20 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.383717:0:19025:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:2.0:1788263602.383721:0:19025:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263602.383794:0:19025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943473dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+19:2361:x1875129735986304:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 144us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263602.383819:0:19025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788263602.383901:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263602.384050:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735986432 00000100:00100000:2.0:1788263602.384055:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735986432 00000100:00100000:2.0:1788263602.384093:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:2.0:1788263602.384102:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+19:17395:x1875129735986432:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:2.0:1788263602.384160:0:19040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc513957802 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.384175:0:19040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc513957802 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.384186:0:19040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc513957802 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.384212:0:19040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc513957802 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.384259:0:19040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc513957802 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.384265:0:19040:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc513957802 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.384271:0:19040:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994376100e00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263602.384276:0:19040:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc513957802 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.384284:0:19040:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc513957802 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.384293:0:19040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:2.0:1788263602.384303:0:19040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788263602.384308:0:19040:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc513957802 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.384314:0:19040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994376100e00/0x1a657bc513957802 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263602.384358:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+19:17395:x1875129735986432:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 257us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263602.384365:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:3.0:1788263602.400414:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263602.400861:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735986688 00000100:00100000:0.0:1788263602.400881:0:19043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735986688 00000100:00100000:0.0:1788263602.400972:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1788263602.400984:0:19043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+19:17395:x1875129735986688:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788263602.401514:0:19043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+20:17395:x1875129735986688:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 529us (1105us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788263602.401522:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:0.0:1788263602.427563:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753799040:0@lo:400:kworker.0 00000100:00100000:0.0:1788263602.427640:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263602.427702:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753799552:0@lo:400:kworker.0 00000100:00100000:0.0:1788263602.427735:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263602.427760:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788263602.427780:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3321:1875129753798912:0@lo:400:kworker.0 00000100:00100000:0.0:1788263602.427810:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263602.427829:0:3321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753799424:0@lo:400:kworker.0 00000100:00100000:0.0:1788263602.427850:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263602.427909:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753798784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788263602.427958:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263602.427992:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753799296:0@lo:400:kworker.0 00000100:00100000:1.0:1788263602.428011:0:19035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753798912 00000100:00100000:1.0:1788263602.428020:0:19035:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753798912 00000100:00100000:2.0:1788263602.428032:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788263602.428051:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788263602.428058:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753799168:0@lo:400:kworker.0 00000100:00100000:2.0:1788263602.428084:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263602.428094:0:19035:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788263602.428107:0:19035:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:3321:x1875129753798912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263602.428116:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753799040 00000100:00100000:2.0:1788263602.428122:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753799040 00000100:00100000:2.0:1788263602.428165:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753799168 00000100:00100000:1.0:1788263602.428169:0:19035:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2+19:3321:x1875129753798912:12345-0@lo:400:kworker.0 Request processed in 64us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263602.428170:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753799168 00000100:00100000:1.0:1788263602.428182:0:19035:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788263602.428199:0:19727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263602.428210:0:19727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753799040:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788263602.428258:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788263602.428264:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263602.428273:0:19727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875129753799040:12345-0@lo:400:kworker.0 Request processed in 66us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263602.428276:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753799552 00000100:00100000:1.0:1788263602.428282:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753799552 00000100:00100000:2.0:1788263602.428283:0:19727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788263602.428301:0:19727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788263602.428309:0:19727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753799168:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788263602.428316:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788263602.428340:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753799424 00000100:00100000:1.0:1788263602.428344:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753799424 00000100:00100000:2.0:1788263602.428361:0:19727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753799168:12345-0@lo:400:kworker.0 Request processed in 52us (276us total) trans 0 rc 0/0 00000100:00080000:1.0:1788263602.428361:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263602.428371:0:19727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788263602.428379:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753799296 00000100:00100000:1.0:1788263602.428383:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753799296 00000100:00100000:1.0:1788263602.428401:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788263602.428408:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753799552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788263602.428418:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753799168:0@lo:400:kworker.0 00000100:00100000:1.0:1788263602.428449:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875129753799552:12345-0@lo:400:kworker.0 Request processed in 41us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263602.428456:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788263602.428475:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788263602.428481:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753799424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263602.428508:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875129753799424:12345-0@lo:400:kworker.0 Request processed in 27us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263602.428513:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788263602.428525:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788263602.428531:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753799296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788263602.428569:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1875129753799296:12345-0@lo:400:kworker.0 Request processed in 39us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263602.428576:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788263602.428838:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1875129753799296:0@lo:400:kworker.0 00000100:00100000:0.0:1788263602.428960:0:19730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753798784 00000100:00100000:0.0:1788263602.428965:0:19730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753798784 00000100:00100000:0.0:1788263602.429005:0:19730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788263602.429014:0:19730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753798784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788263602.429057:0:19730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788263602.429109:0:19730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753798784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263602.429115:0:19730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788263602.429144:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a426cf63-d1b6-4c2d-a51f-ea6e6d6142b2:3321:1875129753798912:0@lo:400:kworker.0 00000100:00100000:0.0:1788263602.429156:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1875129753799424:0@lo:400:kworker.0 00000100:00100000:0.0:1788263602.429180:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1875129753799040:0@lo:400:kworker.0 00000100:00100000:0.0:1788263602.429188:0:3321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1875129753799552:0@lo:400:kworker.0 00000100:00100000:3.0:1788263602.429912:0:3322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753799680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788263602.429967:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263602.430005:0:19730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753799680 00000100:00100000:3.0:1788263602.430011:0:19730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753799680 00000100:00100000:3.0:1788263602.430039:0:19730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263602.430046:0:19730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753799680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788263602.430070:0:19730:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788263602.430106:0:19730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347206d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1875129753799680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263602.430112:0:19730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788263602.430147:0:3322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994347204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1875129753799680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788263602.431286:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753798784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788263602.809651:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263602.809891:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735986944 00000100:00100000:1.0:1788263602.809905:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735986944 00000100:00100000:1.0:1788263602.809992:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1788263602.810005:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+20:17426:x1875129735986944:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:1.0:1788263602.810037:0:19040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263602.810084:0:19040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957809 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36b7 expref: -99 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.810258:0:19040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957810 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.810276:0:19040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957810 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.810289:0:19040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957810 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788263602.810302:0:19040:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788263602.810491:0:19040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957809 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36b7 expref: 23 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.810527:0:19040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957810 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36b7 expref: 22 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263602.810539:0:19040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:1.0:1788263602.810543:0:19040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263602.810547:0:19040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899a00, rc 0) 00000100:00100000:1.0:1788263602.810647:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+22:17426:x1875129735986944:12345-192.168.201.29@tcp:101:cat.0 Request processed in 643us (1012us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1788263602.810655:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1788263602.815495:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263602.815564:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.815657:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735987328 00000100:00100000:3.0:1788263602.815675:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735987328 00000100:00100000:3.0:1788263602.815772:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1788263602.815807:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+22:2362:x1875129735987328:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788263602.815825:0:19027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263602.815851:0:19027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957810 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36b7 expref: 22 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.815888:0:19027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:3.0:1788263602.815893:0:19027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788263602.815971:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+21:2362:x1875129735987328:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 176us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263602.815979:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1788263602.816633:0:19043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735987200 00000100:00100000:0.0:1788263602.816645:0:19043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735987200 00000100:00100000:0.0:1788263602.816734:0:19043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1788263602.816746:0:19043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+21:17426:x1875129735987200:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:0.0:1788263602.817589:0:19043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+22:17426:x1875129735987200:12345-192.168.201.29@tcp:35:cat.0 Request processed in 471us (1735us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788263602.817601:0:19043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00010000:00010000:2.0:1788263602.875491:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788263602.896335:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.896816:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735987584 00000100:00100000:3.0:1788263602.896830:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735987584 00000100:00100000:3.0:1788263602.896921:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:3.0:1788263602.896933:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+22:17432:x1875129735987584:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:3.0:1788263602.898186:0:19041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263602.898726:0:19041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994376101800/0x1a657bc51395781e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36be expref: -99 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.898871:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994376101200/0x1a657bc513957825 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.898890:0:19041:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994376101000/0x1a657bc5139577c3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d369b expref: 23 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.898899:0:19041:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36a2 expref: 23 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.898908:0:19041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994376101200/0x1a657bc513957825 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.898945:0:19041:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36a2 expref: 23 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.898962:0:19041:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36a2 expref: 23 pid: 19042 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263602.898976:0:19041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:19041:1875129753799808:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788263602.899109:0:19041:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994376101000/0x1a657bc5139577c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d369b expref: 23 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.899120:0:19041:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994376101000/0x1a657bc5139577c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d369b expref: 23 pid: 19040 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263602.899130:0:19041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437a7bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:19041:1875129753799936:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263602.899154:0:19041:0:(client.c:2715:ptlrpc_set_wait()) set ffff994349d089c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788263602.904792:0:19041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:19041:1875129753799808:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788263602.905130:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263602.905174:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263602.905264:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735987712 00000100:00100000:0.0:1788263602.905272:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735987712 00010000:00010000:0.0:1788263602.905315:0:19027:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36a2 expref: 24 pid: 19042 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263602.905351:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735987840 00000100:00100000:0.0:1788263602.905354:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735987840 00010000:00010000:0.0:1788263602.905369:0:19027:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994376101000/0x1a657bc5139577c3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d369b expref: 25 pid: 19040 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263602.905385:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1788263602.905395:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437fb41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+25:2362:x1875129735987712:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263602.905408:0:19027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263602.905414:0:19027:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36a2 expref: 25 pid: 19042 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.905445:0:19027:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36a2 expref: 25 pid: 19042 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.905467:0:19027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159000/0x1a657bc5139577d8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36a2 expref: 25 pid: 19042 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.905483:0:19027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:0.0:1788263602.905488:0:19027:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994376101200/0x1a657bc513957825 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.905496:0:19027:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff994376101200/0x1a657bc513957825 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.905502:0:19027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263602.905554:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437fb41c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+24:2362:x1875129735987712:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 160us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263602.905561:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1788263602.905606:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1788263602.905614:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+23:2362:x1875129735987840:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788263602.905624:0:19027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788263602.905629:0:19027:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994376101000/0x1a657bc5139577c3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d369b expref: 23 pid: 19040 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.905637:0:19027:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994376101000/0x1a657bc5139577c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d369b expref: 23 pid: 19040 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.905661:0:19027:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:0.0:1788263602.905665:0:19027:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff994376101200/0x1a657bc513957825 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.905673:0:19027:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994376101200/0x1a657bc513957825 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.905680:0:19027:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994376101200/0x1a657bc513957825 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263602.905698:0:19027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263602.905718:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+23:2362:x1875129735987840:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 105us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263602.905724:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00010000:00010000:3.0:1788263602.906742:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994376101000/0x1a657bc5139577c3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d369b expref: 22 pid: 19040 timeout: 729 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263602.906891:0:19041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437a7bb100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:19041:1875129753799936:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263602.906917:0:19041:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff994376101200/0x1a657bc513957825 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.906926:0:19041:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff994376101200/0x1a657bc513957825 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.906932:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994376101200/0x1a657bc513957825 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263602.906961:0:19041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788263602.907140:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994376101800/0x1a657bc51395781e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36be expref: 23 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.907155:0:19041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994376101200/0x1a657bc513957825 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36be expref: 22 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.907162:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:3.0:1788263602.907164:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788263602.907167:0:19041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994376101200, rc 0) 00000100:00100000:3.0:1788263602.907209:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+22:17432:x1875129735987584:12345-192.168.201.29@tcp:101:dd.0 Request processed in 10278us (10887us total) trans 12884901905 rc 0/0 00000100:00100000:3.0:1788263602.907342:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:2.0:1788263602.911399:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.912390:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735988096 00000100:00100000:3.0:1788263602.912403:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735988096 00000100:00100000:3.0:1788263602.912451:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1788263602.912457:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+22:17432:x1875129735988096:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:3.0:1788263602.912697:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957833 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.912710:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957833 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.912718:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957833 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263602.912754:0:19042:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:3.0:1788263602.912890:0:19042:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000091e5085 reply state 00000000f88bb562 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957833 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263602.912900:0:19042:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263602.913362:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+25:17432:x1875129735988096:12345-192.168.201.29@tcp:36:dd.0 Request processed in 901us (1967us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1788263602.913372:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000020:00080000:3.0:1788263602.913377:0:19042:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788263602.918539:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957833 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.918557:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957833 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.918564:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957833 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.918571:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159800 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263602.918576:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957833 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.918584:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957833 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.918604:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:2.0:1788263602.918607:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263602.918627:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957833 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.918634:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159800/0x1a657bc513957833 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263602.921297:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.921417:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735988224 00000100:00100000:3.0:1788263602.921427:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735988224 00000100:00100000:3.0:1788263602.921491:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:3.0:1788263602.921501:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+24:17432:x1875129735988224:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:3.0:1788263602.921525:0:19041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263602.921547:0:19041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc51395783a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36c5 expref: -99 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.921609:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc51395783a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36c5 expref: 25 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.921623:0:19041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc51395783a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36c5 expref: 25 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.921641:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:3.0:1788263602.921645:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263602.921648:0:19041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158c00, rc 0) 00000100:00100000:3.0:1788263602.921736:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+25:17432:x1875129735988224:12345-192.168.201.29@tcp:101:dd.0 Request processed in 236us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263602.921743:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:0.0:1788263602.938708:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.939039:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735988480 00000100:00100000:3.0:1788263602.939050:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735988480 00000100:00100000:2.0:1788263602.939378:0:19025:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788263602.939393:0:19025:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+25:17432:x1875129735988480:12345-192.168.201.29@tcp:103:dd.0 00010000:00010000:2.0:1788263602.939411:0:19025:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263602.939438:0:19025:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158c00/0x1a657bc51395783a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36c5 expref: 25 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263602.939458:0:19025:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:2.0:1788263602.939463:0:19025:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263602.939561:0:19025:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+24:17432:x1875129735988480:12345-192.168.201.29@tcp:103:dd.0 Request processed in 171us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263602.939569:0:19025:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788263602.945546:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.945689:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735988608 00000100:00100000:3.0:1788263602.945699:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735988608 00000100:00100000:3.0:1788263602.945836:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1788263602.945848:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+24:17432:x1875129735988608:12345-192.168.201.29@tcp:58:dd.0 00010000:00010000:3.0:1788263602.945956:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.945974:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.945985:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263602.946778:0:19042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788263602.946953:0:19042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1788263602.947024:0:19042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1788263602.947141:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+24:17432:x1875129735988608:12345-192.168.201.29@tcp:58:dd.0 Request processed in 1291us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263602.947151:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:0.0:1788263602.951567:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263602.951672:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735988736 00000100:00100000:3.0:1788263602.951683:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735988736 00000100:00100000:3.0:1788263602.951941:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:3.0:1788263602.951952:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+24:17432:x1875129735988736:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:3.0:1788263602.951974:0:19041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263602.951994:0:19041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513957848 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36cc expref: -99 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.952050:0:19041:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.952071:0:19041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513957848 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36cc expref: 25 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.952089:0:19041:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.952105:0:19041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513957848 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36cc expref: 25 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.952442:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:3.0:1788263602.952446:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788263602.952451:0:19041:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513957848 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36cc expref: 25 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263602.952459:0:19041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158a00, rc 0) 00000100:00100000:2.0:1788263602.952650:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+25:17432:x1875129735988736:12345-192.168.201.29@tcp:101:dd.0 Request processed in 698us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263602.952657:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000040:00080000:0.0:1788263603.131623:0:19070:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788263603.131634:0:19070:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788263603.131675:0:19070:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788263603.131682:0:19070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788263603.131823:0:19070:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:19070:1875129753800064:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788263603.132058:0:19070:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788263603.146681:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.146916:0:19051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735988864 00000100:00100000:3.0:1788263603.146927:0:19051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735988864 00000100:00100000:3.0:1788263603.147005:0:19051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788263603.147017:0:19051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:42f281e6-4ca9-42e3-af58-12fb1244acb4+26:17434:x1875129735988864:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788263603.147100:0:19051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:42f281e6-4ca9-42e3-af58-12fb1244acb4+26:17434:x1875129735988864:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 Request processed in 86us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263603.147108:0:19051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00080000:1.0:1788263603.147882:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788263603.149478:0:19070:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b5c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:19070:1875129753800064:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788263603.150472:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.150545:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735988992 00000100:00100000:3.0:1788263603.150553:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735988992 00000100:00100000:3.0:1788263603.150608:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1788263603.150617:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+25:17434:x1875129735988992:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788263603.150664:0:19042:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788263603.150993:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+25:17434:x1875129735988992:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 375us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263603.151001:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:1.0:1788263603.166617:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263603.175353:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735989120 00000100:00100000:2.0:1788263603.175370:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735989120 00000100:00100000:2.0:1788263603.175520:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:2.0:1788263603.175532:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+25:17434:x1875129735989120:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788263603.175623:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100c00/0x1a657bc51395784f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175640:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994376100c00/0x1a657bc51395784f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175652:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994376100c00/0x1a657bc51395784f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175666:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100200/0x1a657bc513957856 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175673:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994376100200/0x1a657bc513957856 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175679:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994376100200/0x1a657bc513957856 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175701:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc51395785d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175710:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc51395785d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175717:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc51395785d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788263603.175770:0:19041:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788263603.175774:0:19041:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788263603.175798:0:19041:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc51395785d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175809:0:19041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100c00/0x1a657bc51395784f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175820:0:19041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994376100c00/0x1a657bc51395784f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175827:0:19041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994376100c00/0x1a657bc51395784f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175833:0:19041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994376100c00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263603.175838:0:19041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100c00/0x1a657bc51395784f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.175845:0:19041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100c00/0x1a657bc51395784f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.176982:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9942419f8b00) 00010000:00010000:2.0:1788263603.176990:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263603.176996:0:19041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994376100c00/0x1a657bc51395784f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177006:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994376100c00/0x1a657bc51395784f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177024:0:19041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100200/0x1a657bc513957856 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177030:0:19041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994376100200/0x1a657bc513957856 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177035:0:19041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994376100200/0x1a657bc513957856 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177041:0:19041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994376100200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263603.177058:0:19041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100200/0x1a657bc513957856 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177065:0:19041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100200/0x1a657bc513957856 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177075:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff99435656ba00) 00010000:00010000:2.0:1788263603.177078:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263603.177081:0:19041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994376100200/0x1a657bc513957856 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177086:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994376100200/0x1a657bc513957856 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177102:0:19041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc51395785d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177108:0:19041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc51395785d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177113:0:19041:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc51395785d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177489:0:19041:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994376100000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263603.177494:0:19041:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc51395785d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177500:0:19041:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc51395785d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177510:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:2.0:1788263603.177512:0:19041:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263603.177525:0:19041:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc51395785d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.177532:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc51395785d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263603.177641:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+25:17434:x1875129735989120:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 2107us (11032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263603.177652:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:0.0:1788263603.183970:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.184148:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735989376 00000100:00100000:3.0:1788263603.184160:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735989376 00000100:00100000:3.0:1788263603.184235:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:3.0:1788263603.184247:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+25:17434:x1875129735989376:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263603.184269:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263603.184288:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc513957864 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36d3 expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184394:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395786b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184408:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395786b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184420:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395786b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788263603.184431:0:19042:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788263603.184529:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395786b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184537:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395786b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184544:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395786b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184565:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:3.0:1788263603.184569:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395786b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184577:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395786b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184591:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:3.0:1788263603.184594:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788263603.184598:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395786b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184604:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc51395786b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184645:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc513957864 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36d3 expref: 27 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184655:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9942419f8b00) 00010000:00010000:3.0:1788263603.184658:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788263603.184662:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc513957864 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36d3 expref: 27 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.184669:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343159400, rc 0) 00000100:00100000:3.0:1788263603.184989:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+26:17434:x1875129735989376:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 743us (1029us total) trans 12884901908 rc 301/301 00000100:00100000:3.0:1788263603.184998:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:2.0:1788263603.190462:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263603.191252:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735989504 00000100:00100000:0.0:1788263603.191266:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735989504 00000100:00100000:0.0:1788263603.191330:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:0.0:1788263603.191341:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+26:17434:x1875129735989504:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788263603.191394:0:19041:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788263603.191515:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+26:17434:x1875129735989504:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 175us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263603.191522:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:0.0:1788263603.195822:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263603.202426:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735989760 00000100:00100000:1.0:1788263603.202444:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735989760 00000100:00100000:1.0:1788263603.202513:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:1.0:1788263603.202524:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+26:17434:x1875129735989760:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263603.202548:0:19040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263603.202572:0:19040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957879 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36da expref: -99 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788263603.209209:0:19040:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x23:0x0], count =31 00000004:00080000:1.0:1788263603.209241:0:19040:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788263603.209294:0:19040:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:1.0:1788263603.209593:0:19040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957880 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.209610:0:19040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957880 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.209621:0:19040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957880 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.209686:0:19040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc513957879 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36da expref: 29 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.209705:0:19040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957880 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36da expref: 28 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.209715:0:19040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9943435a7c00) 00010000:00010000:1.0:1788263603.209718:0:19040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788263603.209721:0:19040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242899a00, rc 0) 00000100:00100000:1.0:1788263603.210727:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+28:17434:x1875129735989760:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 8198us (14910us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788263603.210739:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:2.0:1788263603.228844:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.229067:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735990016 00000100:00100000:3.0:1788263603.229092:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735990016 00000100:00100000:3.0:1788263603.229166:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:3.0:1788263603.229178:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437a7ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+28:17434:x1875129735990016:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263603.229283:0:19042:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788263603.229311:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899a00/0x1a657bc513957880 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36da expref: 28 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.229329:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9943435a7c00) 00010000:00010000:3.0:1788263603.229340:0:19042:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788263603.229364:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc51395788e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.229377:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc51395788e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.229386:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc51395788e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229581:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc513957895 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xae597394 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229591:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc513957895 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae597394 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229598:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc513957895 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae597394 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229671:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc51395788e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229678:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc51395788e lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229685:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc51395788e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229691:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263603.229695:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc51395788e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229714:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc51395788e lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229723:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9943564fbd00) 00010000:00010000:2.0:1788263603.229726:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263603.229730:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc51395788e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229736:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc51395788e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229745:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc513957895 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae597394 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229750:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc513957895 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae597394 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229755:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc513957895 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae597394 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229760:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994376100000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263603.229764:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc513957895 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae597394 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229770:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc513957895 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xae597394 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229777:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xae597394 (ffff99435656ba00) 00010000:00010000:2.0:1788263603.229780:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263603.229782:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc513957895 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xae597394 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.229808:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994376100000/0x1a657bc513957895 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xae597394 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263603.230026:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437a7ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+27:17434:x1875129735990016:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 848us (1189us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788263603.230033:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:3.0:1788263603.233602:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263603.233915:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735990144 00000100:00100000:1.0:1788263603.233925:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735990144 00000100:00100000:1.0:1788263603.233983:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:1.0:1788263603.233992:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+27:17434:x1875129735990144:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263603.234011:0:19040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263603.234033:0:19040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395789c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36e1 expref: -99 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.234068:0:19040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898800/0x1a657bc5139578a3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.234081:0:19040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242898800/0x1a657bc5139578a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.234092:0:19040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898800/0x1a657bc5139578a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19040 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.234352:0:19040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898600/0x1a657bc51395789c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36e1 expref: 29 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.234370:0:19040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898800/0x1a657bc5139578a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36e1 expref: 28 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.234379:0:19040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9943435a7e00) 00010000:00010000:1.0:1788263603.234382:0:19040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788263603.234393:0:19040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242898800, rc 0) 00000100:00100000:1.0:1788263603.234455:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+28:17434:x1875129735990144:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 462us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263603.234462:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:0.0:1788263603.239740:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.239846:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735990400 00000100:00100000:3.0:1788263603.239866:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735990400 00000100:00100000:3.0:1788263603.239926:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:3.0:1788263603.239937:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+28:17434:x1875129735990400:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788263603.240025:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139578aa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.240041:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139578aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.240052:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139578aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788263603.240611:0:19042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1788263603.240623:0:19042:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 630028404593ns, next at 631028402613ns, rc = 0 00000004:00010000:3.0:1788263603.240707:0:19042:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fce2328 reply state 0000000090542b3f transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139578aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263603.240717:0:19042:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788263603.240819:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+30:17434:x1875129735990400:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 882us (1087us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1788263603.240827:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00010000:00010000:1.0:1788263603.246384:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139578aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.246404:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139578aa lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.246414:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139578aa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.246420:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:1.0:1788263603.246425:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139578aa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.246434:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139578aa lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.246452:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9943435a7e00) 00010000:00010000:1.0:1788263603.246455:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788263603.246460:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139578aa lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.246465:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158400/0x1a657bc5139578aa lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263603.248437:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263603.248509:0:19040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735990528 00000100:00100000:1.0:1788263603.248519:0:19040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735990528 00000100:00100000:1.0:1788263603.248581:0:19040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1788263603.248592:0:19040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+29:17434:x1875129735990528:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788263603.248631:0:19040:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788263603.248652:0:19040:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139578b1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36e8 expref: -99 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.248712:0:19040:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139578b1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36e8 expref: 30 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.248728:0:19040:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139578b1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36e8 expref: 30 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.248747:0:19040:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9943435a7e00) 00010000:00010000:1.0:1788263603.248750:0:19040:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788263603.248762:0:19040:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994242898400, rc 0) 00000100:00100000:1.0:1788263603.248837:0:19040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:42f281e6-4ca9-42e3-af58-12fb1244acb4+30:17434:x1875129735990528:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 247us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263603.248845:0:19040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:2.0:1788263603.251298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.251358:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735990656 00000100:00100000:3.0:1788263603.251368:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735990656 00000100:00100000:3.0:1788263603.251438:0:19727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1788263603.251449:0:19727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943755bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:2362:x1875129735990656:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788263603.251810:0:19727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943755bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:2362:x1875129735990656:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 362us (520us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788263603.251816:0:19727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00080000:1.0:1788263603.251875:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788263603.261198:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.261310:0:19044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735990912 00000100:00100000:3.0:1788263603.261322:0:19044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735990912 00000100:00100000:3.0:1788263603.261376:0:19044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1788263603.261387:0:19044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+30:17434:x1875129735990912:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788263603.261631:0:19044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+31:17434:x1875129735990912:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 245us (442us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1788263603.261640:0:19044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788263603.266959:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263603.268005:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735991168 00000100:00100000:2.0:1788263603.268017:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735991168 00000100:00100000:2.0:1788263603.268090:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:2.0:1788263603.268102:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+31:17434:x1875129735991168:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788263603.268587:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+31:17434:x1875129735991168:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 485us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263603.268595:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:2.0:1788263603.272091:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263603.276527:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735991296 00000100:00100000:0.0:1788263603.276544:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735991296 00000100:00100000:0.0:1788263603.276687:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:0.0:1788263603.276699:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+31:17434:x1875129735991296:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788263603.276723:0:19042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788263603.276748:0:19042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139578b8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36ef expref: -99 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.276839:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139578bf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.276863:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139578bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.276876:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139578bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788263603.276912:0:19042:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788263603.276930:0:19042:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139578bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.276988:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216de00/0x1a657bc5139578b8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36ef expref: 33 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.277009:0:19042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139578bf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36ef expref: 32 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.277018:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9943435a7e00) 00010000:00010000:0.0:1788263603.277022:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788263603.277026:0:19042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99438216cc00, rc 0) 00000100:00100000:0.0:1788263603.277110:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+32:17434:x1875129735991296:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 412us (5029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263603.278840:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1788263603.284903:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263603.285956:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735991424 00000100:00100000:2.0:1788263603.285971:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735991424 00000100:00100000:2.0:1788263603.286030:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:2.0:1788263603.286041:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994347207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+6:2361:x1875129735991424:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788263603.286061:0:19728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788263603.286087:0:19728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c308bde/0x1a657bc5139578c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36f6 expref: -99 pid: 19728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788263603.286118:0:19728:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96bcb3, blocks: 0x1 00010000:00010000:2.0:1788263603.286156:0:19728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=630s v=(0 0) 00010000:00010000:2.0:1788263603.286161:0:19728:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263603.286172:0:19728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c308bde/0x1a657bc5139578c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36f6 expref: 7 pid: 19728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.286194:0:19728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c308bde/0x1a657bc5139578c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36f6 expref: 7 pid: 19728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.286210:0:19728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994376101600, rc 0) 00000100:00100000:2.0:1788263603.286316:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994347207800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:2361:x1875129735991424:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 276us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263603.286324:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:2.0:1788263603.291657:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263603.300098:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735991680 00000100:00100000:0.0:1788263603.300116:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735991680 00000100:00100000:1.0:1788263603.301115:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:1.0:1788263603.301128:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+32:17434:x1875129735991680:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788263603.301294:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+32:17434:x1875129735991680:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 167us (9645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263603.301302:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:0.0:1788263603.304997:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.305094:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735991808 00000100:00100000:3.0:1788263603.305117:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735991808 00000100:00100000:3.0:1788263603.305176:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:3.0:1788263603.305187:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+32:17434:x1875129735991808:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788263603.356612:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901904 is committed 00000001:00080000:2.0:1788263603.356636:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901892 is committed 00000001:00080000:2.0:1788263603.356646:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901909 is committed 00000001:00080000:2.0:1788263603.356665:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:2.0:1788263603.356678:0:5874:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00000004:00080000:2.0:1788263603.356685:0:5874:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788263603.356911:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+14:17434:x1875129735991808:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 51720us (51918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263603.356923:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:2.0:1788263603.358081:0:3323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753800192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788263603.358139:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788263603.358344:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753800192 00000100:00100000:1.0:1788263603.358352:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753800192 00000100:00100000:1.0:1788263603.358402:0:19727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263603.358413:0:19727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99438118a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1875129753800192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788263603.358712:0:19727:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788263603.358717:0:19727:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788263603.358719:0:19727:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788263603.358722:0:19727:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788263603 -> 1788263603 00002000:00010000:1.0:1788263603.358724:0:19727:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:2.0:1788263603.358912:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff994375bfa300/2, rc 0, transno 12884901891 00000100:00100000:2.0:1788263603.358920:0:3323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff994375bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1875129753800192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788263603.358959:0:19727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99438118a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3323:x1875129753800192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 547us (818us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788263603.358968:0:19727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788263603.367990:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.369758:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735991936 00000100:00100000:3.0:1788263603.369774:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735991936 00000100:00100000:3.0:1788263603.369927:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1788263603.369937:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:2362:x1875129735991936:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788263603.370123:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:2362:x1875129735991936:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 186us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263603.370132:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:2.0:1788263603.384046:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263603.384149:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735992192 00000100:00100000:1.0:1788263603.384160:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735992192 00000100:00100000:1.0:1788263603.384288:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:1.0:1788263603.384300:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+14:17434:x1875129735992192:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788263603.384365:0:19041:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263603.384394:0:19041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216cc00/0x1a657bc5139578bf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36ef expref: 14 pid: 19042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.384414:0:19041:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9943435a7e00) 00010000:00010000:1.0:1788263603.384419:0:19041:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788263603.384693:0:19041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139578cd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.384708:0:19041:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139578cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.384719:0:19041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139578cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788263603.385672:0:19041:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010f28709 reply state 00000000177a9ee7 transno 12884901912 ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139578cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263603.385687:0:19041:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788263603.386087:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+15:17434:x1875129735992192:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1786us (2049us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1788263603.386096:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:1.0:1788263603.395005:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.395077:0:20244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735992320 00000100:00100000:3.0:1788263603.395088:0:20244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735992320 00000100:00100000:3.0:1788263603.395148:0:20244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1788263603.395159:0:20244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:17434:x1875129735992320:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788263603.395177:0:20244:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788263603.395196:0:20244:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3957daceab5d36fd expref: -99 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.395266:0:20244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c308bde/0x1a657bc5139578c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36f6 expref: 8 pid: 19728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.395275:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263603.395279:0:20244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263603.395284:0:20244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 8 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.395337:0:20244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c308bde/0x1a657bc5139578c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36f6 expref: 8 pid: 19728 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.395351:0:20244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c308bde/0x1a657bc5139578c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36f6 expref: 8 pid: 19728 timeout: 730 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263603.395366:0:20244:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:20244:1875129753800320:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263603.395453:0:20244:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943412ed000 going to sleep for 11 seconds 00010000:00010000:2.0:1788263603.396976:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139578cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.397007:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139578cd lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.397015:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139578cd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.397021:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242899200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263603.397026:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139578cd lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.397033:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139578cd lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.397051:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9943435a7e00) 00010000:00010000:2.0:1788263603.397054:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263603.397059:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139578cd lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.397064:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242899200/0x1a657bc5139578cd lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19041 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263603.403623:0:20244:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:20244:1875129753800320:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263603.403662:0:20244:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 8 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.403683:0:20244:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff994343158400, rc 0) 00000100:00100000:3.0:1788263603.403756:0:20244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:42f281e6-4ca9-42e3-af58-12fb1244acb4+8:17434:x1875129735992320:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 8592us (8755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263603.403765:0:20244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788263603.406799:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263603.407126:0:19026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735992448 00000100:00100000:1.0:1788263603.407136:0:19026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735992448 00010000:00010000:1.0:1788263603.407185:0:19026:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c308bde/0x1a657bc5139578c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36f6 expref: 8 pid: 19728 timeout: 730 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263603.407269:0:19026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1788263603.407280:0:19026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+8:2361:x1875129735992448:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788263603.407296:0:19026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788263603.407321:0:19026:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c308bde/0x1a657bc5139578c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36f6 expref: 8 pid: 19728 timeout: 730 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.407335:0:19026:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c308bde/0x1a657bc5139578c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36f6 expref: 8 pid: 19728 timeout: 730 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.407360:0:19026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c308bde/0x1a657bc5139578c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36f6 expref: 8 pid: 19728 timeout: 730 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.407378:0:19026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263603.407383:0:19026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263603.407390:0:19026:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 7 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.407401:0:19026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 7 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.407746:0:19026:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 7 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263603.407767:0:19026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19026:1875129753800448:192.168.201.29@tcp:105: 00000100:00100000:0.0:1788263603.407862:0:19026:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263603.419919:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263603.420038:0:19026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:19026:1875129753800448:192.168.201.29@tcp:105: 00010000:00010000:0.0:1788263603.420062:0:19026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788263603.420121:0:19026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:2361:x1875129735992448:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 12842us (13332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788263603.420132:0:19026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788263603.420677:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735992576 00000100:00100000:3.0:1788263603.420687:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735992576 00000100:00100000:3.0:1788263603.420735:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1788263603.420744:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:2361:x1875129735992576:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788263603.420967:0:19728:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788263603.420971:0:19728:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788263602 00002000:00010000:3.0:1788263603.420974:0:19728:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788263601 00002000:00010000:3.0:1788263603.420988:0:19728:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788263603 -> 1788263602 00002000:00010000:3.0:1788263603.420991:0:19728:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788263603.421037:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+8:2361:x1875129735992576:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 294us (1128us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788263603.421045:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:1.0:1788263603.433620:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.433706:0:19727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735992704 00000100:00100000:3.0:1788263603.433716:0:19727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735992704 00000100:00100000:3.0:1788263603.433783:0:19727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788263603.433794:0:19727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+8:2360:x1875129735992704:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788263603.433840:0:19727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.433871:0:19727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 8 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.433881:0:19727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263603.433886:0:19727:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788263603.433890:0:19727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 4/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.433927:0:19727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 8 pid: 20244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.433941:0:19727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 8 pid: 20244 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263603.433978:0:19727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19727:1875129753800576:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788263603.434071:0:19727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9943412ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1788263603.441285:0:19727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:19727:1875129753800576:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263603.441317:0:19727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263603.447887:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263603.447998:0:19027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735992832 00000100:00100000:2.0:1788263603.448008:0:19027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735992832 00010000:00010000:2.0:1788263603.448054:0:19027:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 9 pid: 20244 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263603.448105:0:19027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1788263603.448115:0:19027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+9:2361:x1875129735992832:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263603.448141:0:19027:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263603.448177:0:19027:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 9 pid: 20244 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.448191:0:19027:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 9 pid: 20244 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.448213:0:19027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007332f49c/0x1a657bc5139578d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36fd expref: 9 pid: 20244 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.448275:0:19027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263603.448279:0:19027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788263603.448284:0:19027:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.448294:0:19027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.448322:0:19027:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263603.448375:0:19027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+8:2361:x1875129735992832:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 261us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263603.448382:0:19027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00010000:00010000:3.0:1788263603.449032:0:19727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.449043:0:19727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.449067:0:19727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.449075:0:19727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.449082:0:19727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.449089:0:19727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263603.449093:0:19727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.449111:0:19727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.449135:0:19727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.449142:0:19727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb86c2f2/0x1a657bc5139578db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263603.449356:0:19727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+7:2360:x1875129735992704:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 15562us (15744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263603.449365:0:19727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1788263603.459988:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788263603.460090:0:19042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735993088 00000100:00100000:0.0:1788263603.460100:0:19042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735993088 00000100:00100000:0.0:1788263603.460165:0:19042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:0.0:1788263603.460176:0:19042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+14:17434:x1875129735993088:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788263603.460304:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139578e2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.460322:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139578e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.460334:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139578e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.460600:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.460612:0:19042:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139578b1 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36e8 expref: 15 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.460631:0:19042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.460667:0:19042:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139578b1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36e8 expref: 15 pid: 19040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.460681:0:19042:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139578b1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36e8 expref: 15 pid: 19040 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263603.460695:0:19042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19042:1875129753800704:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788263603.460784:0:19042:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263603.467375:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263603.467588:0:19026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735993216 00000100:00100000:2.0:1788263603.467601:0:19026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735993216 00010000:00010000:2.0:1788263603.467642:0:19026:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139578b1 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36e8 expref: 16 pid: 19040 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263603.467684:0:19026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:2.0:1788263603.467709:0:19026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+16:2361:x1875129735993216:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788263603.467725:0:19026:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788263603.467732:0:19026:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139578b1 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36e8 expref: 16 pid: 19040 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.467745:0:19026:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139578b1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36e8 expref: 16 pid: 19040 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.467781:0:19026:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9943435a7e00) 00010000:00010000:2.0:1788263603.467786:0:19026:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.467796:0:19026:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.467805:0:19026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.467823:0:19026:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788263603.467889:0:19026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+16:2361:x1875129735993216:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 182us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788263603.467897:0:19026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00010000:00010000:3.0:1788263603.469166:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994242898400/0x1a657bc5139578b1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36e8 expref: 15 pid: 19040 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263603.469195:0:19042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19042:1875129753800704:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788263603.469348:0:19042:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.469358:0:19042:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.469364:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263603.470117:0:19042:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1788263603.470794:0:19042:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:3.0:1788263603.470865:0:19042:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:3.0:1788263603.470956:0:19042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:19042:1875129753800832:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788263603.471050:0:19042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788263603.471091:0:19042:0:(client.c:2715:ptlrpc_set_wait()) set ffff99437fbcee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788263603.471188:0:19045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753800832 00000100:00100000:1.0:1788263603.471196:0:19045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753800832 00000100:00100000:1.0:1788263603.471277:0:19045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788263603.471289:0:19045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19042:x1875129753800832:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788263603.472678:0:19045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:19042:x1875129753800832:12345-0@lo:1000:mdt00_002.0 Request processed in 1383us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788263603.472692:0:19045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788263603.473454:0:19042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99434623d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:19042:1875129753800832:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788263603.475620:0:19042:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:0.0:1788263603.475718:0:19042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:19042:1875129753800960:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788263603.475928:0:19042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788263603.476437:0:19042:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788263603.477031:0:19046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129753800960 00000100:00100000:1.0:1788263603.477041:0:19046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129753800960 00000100:00100000:1.0:1788263603.477144:0:19046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788263603.477154:0:19046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:19042:x1875129753800960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788263603.477594:0:19046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:19042:x1875129753800960:12345-0@lo:1000:mdt00_002.0 Request processed in 439us (1664us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788263603.477603:0:19046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788263603.477687:0:19042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:19042:1875129753800960:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788263603.477728:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477739:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477747:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477767:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216c000 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263603.477780:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477789:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477805:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9943435a7e00) 00010000:00010000:0.0:1788263603.477809:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788263603.477813:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477828:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216c000/0x1a657bc5139578e9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477867:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477875:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477880:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477886:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159200 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:0.0:1788263603.477889:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477895:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477903:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:0.0:1788263603.477906:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788263603.477918:0:19042:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513957848 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36cc expref: 18 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477929:0:19042:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513957848 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36cc expref: 18 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477937:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513957848 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36cc expref: 18 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788263603.477968:0:19042:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff994343158a00/0x1a657bc513957848 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0x3957daceab5d36cc expref: 18 pid: 19041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788263603.477981:0:19042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19042:1875129753801088:192.168.201.29@tcp:105: 00000100:00100000:0.0:1788263603.478069:0:19042:0:(client.c:2715:ptlrpc_set_wait()) set ffff99434702af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788263603.483405:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.483470:0:19044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735993344 00000100:00100000:3.0:1788263603.483479:0:19044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735993344 00000100:00100000:3.0:1788263603.483536:0:19044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788263603.483546:0:19044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994372195c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+19:17432:x1875129735993344:12345-192.168.201.29@tcp:49:dd.0 00000100:00100000:3.0:1788263603.483689:0:19044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994372195c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+19:17432:x1875129735993344:12345-192.168.201.29@tcp:49:dd.0 Request processed in 143us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263603.483696:0:19044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788263603.483824:0:19042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99437f6b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:19042:1875129753801088:192.168.201.29@tcp:105: 00010000:00010000:2.0:1788263603.483858:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.483869:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159200/0x1a657bc513957841 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.483917:0:19042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100400/0x1a657bc5139578f0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.483931:0:19042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994376100400/0x1a657bc5139578f0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.483942:0:19042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994376100400/0x1a657bc5139578f0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.483952:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff994376100400/0x1a657bc5139578f0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.483958:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994376100400/0x1a657bc5139578f0 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.483963:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994376100400/0x1a657bc5139578f0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.483969:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994376100400 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263603.483972:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100400/0x1a657bc5139578f0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.483978:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994376100400/0x1a657bc5139578f0 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.483990:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:2.0:1788263603.483993:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788263603.483997:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994376100400/0x1a657bc5139578f0 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.484002:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994376100400/0x1a657bc5139578f0 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.484019:0:19042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139578e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.484025:0:19042:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139578e2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.484031:0:19042:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139578e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.484036:0:19042:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99438216ce00 already unused, calling callback (ffffffffc1f104f0) 00010000:00010000:2.0:1788263603.484038:0:19042:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139578e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.484045:0:19042:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139578e2 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.484052:0:19042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99435656bb00) 00010000:00010000:2.0:1788263603.484055:0:19042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788263603.484057:0:19042:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139578e2 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.484062:0:19042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99438216ce00/0x1a657bc5139578e2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19042 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263603.484949:0:19042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+18:17434:x1875129735993088:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 24770us (24967us total) trans 12884901917 rc 0/0 00000100:00100000:2.0:1788263603.484959:0:19042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000020:00080000:2.0:1788263603.484964:0:19042:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788263603.485788:0:19070:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788263603.485794:0:19070:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788263603.485823:0:19070:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788263603.485828:0:19070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788263603.491190:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.501467:0:19044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735993600 00000100:00100000:3.0:1788263603.501485:0:19044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735993600 00000100:00100000:3.0:1788263603.501559:0:19044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788263603.501572:0:19044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99437f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+18:17434:x1875129735993600:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788263603.502970:0:19044:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788263603.503090:0:19044:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901918 00010000:00010000:3.0:1788263603.503150:0:19044:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc5139578f7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.503167:0:19044:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc5139578f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 19044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.503188:0:19044:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc5139578f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.503197:0:19044:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc5139578f7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 19044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.503203:0:19044:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc5139578f7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.503209:0:19044:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc5139578f7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 19044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.513542:0:19044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788263603.513684:0:19044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99437f6b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+20:17434:x1875129735993600:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 12109us (22498us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1788263603.513713:0:19044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000020:00080000:2.0:1788263603.513719:0:19044:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788263603.513879:0:19029:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788263603.513889:0:19029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc5139578f7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.513900:0:19029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263603.513904:0:19029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc5139578f7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 19044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.513924:0:19029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc5139578f7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 19044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.513943:0:19029:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9943435a7e00) 00010000:00010000:1.0:1788263603.513946:0:19029:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788263603.513951:0:19029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc5139578f7 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.513957:0:19029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff994343159400/0x1a657bc5139578f7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 19044 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.513969:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263603.513971:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788263603.513972:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788263603.532638:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788263603.532677:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.532771:0:19733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735993856 00000100:00100000:3.0:1788263603.532781:0:19733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735993856 00000100:00100000:3.0:1788263603.532843:0:19733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735993728 00000100:00100000:3.0:1788263603.532855:0:19733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735993728 00000100:00100000:3.0:1788263603.532878:0:19733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788263603.532890:0:19733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+8:2362:x1875129735993856:12345-192.168.201.29@tcp:4:dd.0 00002000:00010000:3.0:1788263603.532940:0:19733:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x6a96bcb2, atime: 0x6a96bcb1, ctime: 0x6a96bcb2, blocks: 0x1 00010000:00010000:3.0:1788263603.532949:0:19733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025f924f1/0x1a657bc5139578fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.532967:0:19733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=630s v=(0 0) 00010000:00010000:3.0:1788263603.532981:0:19733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263603.532988:0:19733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025f924f1/0x1a657bc5139578fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.533004:0:19733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025f924f1/0x1a657bc5139578fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263603.557512:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263603.557645:0:19734:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788263603.557655:0:19734:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788263603.557816:0:19734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735993984 00000100:00100000:1.0:1788263603.557826:0:19734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735993984 00000100:00100000:2.0:1788263603.558525:0:21171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1788263603.558540:0:21171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:42f281e6-4ca9-42e3-af58-12fb1244acb4+10:2362:x1875129735993728:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1788263603.558581:0:21171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc513957905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.558605:0:21171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263603.558610:0:21171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263603.558616:0:21171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc513957905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.558632:0:21171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc513957905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263603.559132:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263603.559162:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263603.559178:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263603.559190:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263603.559207:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788263603.559376:0:19732:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788263603.559385:0:19732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788263603.559467:0:19734:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788263603.559474:0:19734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735994240 00000100:00100000:1.0:1788263603.559480:0:19734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735994240 00000100:00100000:1.0:1788263603.559514:0:19734:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788263603.559518:0:19734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735994496 00000100:00100000:1.0:1788263603.559521:0:19734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735994496 00000100:00100000:1.0:1788263603.559545:0:19734:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788263603.559552:0:19734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735994112 00000100:00100000:1.0:1788263603.559555:0:19734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735994112 00000100:00100000:1.0:1788263603.559566:0:19734:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788263603.559569:0:19734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735994368 00000100:00100000:1.0:1788263603.559571:0:19734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735994368 00000100:00100000:1.0:1788263603.559583:0:19734:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788263603.559586:0:19734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735994624 00000100:00100000:1.0:1788263603.559588:0:19734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735994624 00000100:00100000:1.0:1788263603.559979:0:21172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1788263603.559989:0:21172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994379f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:42f281e6-4ca9-42e3-af58-12fb1244acb4+15:2362:x1875129735993984:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:1.0:1788263603.560015:0:21172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a5af55/0x1a657bc51395790c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.560029:0:21172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263603.560032:0:21172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263603.560037:0:21172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a5af55/0x1a657bc51395790c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.560049:0:21172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a5af55/0x1a657bc51395790c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263603.713711:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00000001:00080000:3.0:1788263603.713731:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00002000:00010000:2.0:1788263603.714923:0:19733:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1788263603.714930:0:19733:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 1788263602 -> 1788263603 00002000:00010000:2.0:1788263603.714933:0:19733:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788263602 -> 1788263603 00002000:00010000:2.0:1788263603.714935:0:19733:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1788263603.714950:0:19733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025f924f1/0x1a657bc5139578fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.714963:0:19733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025f924f1/0x1a657bc5139578fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.714991:0:19733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025f924f1/0x1a657bc5139578fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.714998:0:19733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343158c00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263603.715003:0:19733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025f924f1/0x1a657bc5139578fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.715012:0:19733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025f924f1/0x1a657bc5139578fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.715034:0:19733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025f924f1/0x1a657bc5139578fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.715042:0:19733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025f924f1/0x1a657bc5139578fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263603.715162:0:19733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994381188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+18:2362:x1875129735993856:12345-192.168.201.29@tcp:4:dd.0 Request processed in 182269us (182529us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788263603.715172:0:19733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788263603.715209:0:19733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:2.0:1788263603.717198:0:19733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+17:2361:x1875129735994240:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1788263603.717891:0:19733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f28a675/0x1a657bc513957913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.717910:0:19733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263603.717927:0:19733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263603.717933:0:19733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f28a675/0x1a657bc513957913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.717947:0:19733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f28a675/0x1a657bc513957913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788263603.798039:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1788263603.798072:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1788263603.798731:0:21171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:2.0:1788263603.798737:0:21171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:2.0:1788263603.798762:0:21171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc513957905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.798774:0:21171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc513957905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.798782:0:21171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc513957905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.798788:0:21171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994376100400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263603.798792:0:21171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc513957905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.798807:0:21171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc513957905 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.798829:0:21171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc513957905 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.798862:0:21171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc513957905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263603.798958:0:21171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:42f281e6-4ca9-42e3-af58-12fb1244acb4+15:2362:x1875129735993728:12345-192.168.201.29@tcp:4:dd.0 Request processed in 240417us (266275us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788263603.798967:0:21171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1788263603.798998:0:21171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788263603.799010:0:21171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:42f281e6-4ca9-42e3-af58-12fb1244acb4+14:2361:x1875129735994496:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1788263603.799040:0:21171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018930153/0x1a657bc51395791a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.799052:0:21171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263603.799057:0:21171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263603.799063:0:21171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018930153/0x1a657bc51395791a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.799074:0:21171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018930153/0x1a657bc51395791a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788263603.801973:0:21172:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1788263603.801993:0:21172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6a5af55/0x1a657bc51395790c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.802006:0:21172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a5af55/0x1a657bc51395790c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.802029:0:21172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6a5af55/0x1a657bc51395790c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.802036:0:21172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242898600 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:1.0:1788263603.802041:0:21172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a5af55/0x1a657bc51395790c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.802049:0:21172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6a5af55/0x1a657bc51395790c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.802068:0:21172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6a5af55/0x1a657bc51395790c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.802076:0:21172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a5af55/0x1a657bc51395790c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788263603.802168:0:21172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994379f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:42f281e6-4ca9-42e3-af58-12fb1244acb4+14:2362:x1875129735993984:12345-192.168.201.29@tcp:4:dd.0 Request processed in 242176us (244661us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788263603.802178:0:21172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1788263603.802209:0:21172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788263603.802444:0:21172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:42f281e6-4ca9-42e3-af58-12fb1244acb4+13:2361:x1875129735994112:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:1.0:1788263603.802475:0:21172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da123534/0x1a657bc513957921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.802486:0:21172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263603.802496:0:21172:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788263603.802503:0:21172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da123534/0x1a657bc513957921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788263603.802515:0:21172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da123534/0x1a657bc513957921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788263603.872014:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00002000:00010000:3.0:1788263603.884340:0:19733:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:3.0:1788263603.884350:0:19733:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1788263603.884365:0:19733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f28a675/0x1a657bc513957913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.884377:0:19733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f28a675/0x1a657bc513957913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.884386:0:19733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f28a675/0x1a657bc513957913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.884393:0:19733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994376100200 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263603.884398:0:19733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f28a675/0x1a657bc513957913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.884406:0:19733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f28a675/0x1a657bc513957913 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.884425:0:19733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f28a675/0x1a657bc513957913 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.884432:0:19733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f28a675/0x1a657bc513957913 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263603.884526:0:19733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+15:2361:x1875129735994240:12345-192.168.201.29@tcp:4:dd.0 Request processed in 169303us (325391us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1788263603.884536:0:19733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1788263603.884674:0:19733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788263603.884688:0:19733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+14:2361:x1875129735994368:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:3.0:1788263603.884720:0:19733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc670383/0x1a657bc513957928 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.884733:0:19733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263603.884737:0:19733:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788263603.884744:0:19733:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc670383/0x1a657bc513957928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.884756:0:19733:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc670383/0x1a657bc513957928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.899519:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263603.927642:0:21171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018930153/0x1a657bc51395791a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.927661:0:21171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018930153/0x1a657bc51395791a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.927689:0:21171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018930153/0x1a657bc51395791a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.927697:0:21171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994376100800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263603.927702:0:21171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018930153/0x1a657bc51395791a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.927711:0:21171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018930153/0x1a657bc51395791a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.927730:0:21171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018930153/0x1a657bc51395791a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.927737:0:21171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018930153/0x1a657bc51395791a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263603.927856:0:21171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:42f281e6-4ca9-42e3-af58-12fb1244acb4+16:2361:x1875129735994496:12345-192.168.201.29@tcp:4:dd.0 Request processed in 128844us (368688us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1788263603.927868:0:21171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788263603.927902:0:21171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788263603.927913:0:21171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9943509f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:42f281e6-4ca9-42e3-af58-12fb1244acb4+15:2361:x1875129735994624:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1788263603.927943:0:21171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc51395792f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.927956:0:21171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263603.927967:0:21171:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788263603.927985:0:21171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc51395792f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.927998:0:21171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc51395792f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788263603.930080:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901899 is committed 00010000:00010000:3.0:1788263603.932076:0:21172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da123534/0x1a657bc513957921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.932094:0:21172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da123534/0x1a657bc513957921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.932256:0:21172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da123534/0x1a657bc513957921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.932279:0:21172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994242898e00 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263603.932285:0:21172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da123534/0x1a657bc513957921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.932294:0:21172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da123534/0x1a657bc513957921 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.932315:0:21172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da123534/0x1a657bc513957921 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.932323:0:21172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da123534/0x1a657bc513957921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263603.932411:0:21172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:42f281e6-4ca9-42e3-af58-12fb1244acb4+11:2361:x1875129735994112:12345-192.168.201.29@tcp:4:dd.0 Request processed in 130188us (373226us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1788263603.932420:0:21172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788263603.947896:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.947931:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.947957:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.947992:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.948013:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788263603.948038:0:19033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735994752 00000100:00100000:3.0:1788263603.948049:0:19033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735994752 00000100:00100000:3.0:1788263603.948097:0:19033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:3.0:1788263603.948893:0:19033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff994375a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+13:2359:x1875129735994752:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263603.948981:0:19033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff994375a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:94808cb5-0b27-41af-b9d5-10b2f9721886+13:2359:x1875129735994752:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 98us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263603.948989:0:19033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:3.0:1788263603.949025:0:19041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735995008 00000100:00100000:3.0:1788263603.949029:0:19041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735995008 00000100:00100000:3.0:1788263603.949070:0:19041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1788263603.949077:0:19041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+6:2359:x1875129735995008:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263603.950358:0:19041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:35f00e73-0282-4959-b63a-fcd0dc77029e+6:2359:x1875129735995008:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 1274us (2419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263603.950369:0:19041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1788263603.950404:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735995264 00000100:00100000:3.0:1788263603.950410:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735995264 00000100:00100000:3.0:1788263603.950440:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735994880 00000100:00100000:3.0:1788263603.950444:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735994880 00000100:00100000:3.0:1788263603.950457:0:19728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875129735995136 00000100:00100000:3.0:1788263603.950460:0:19728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875129735995136 00000100:00100000:3.0:1788263603.950474:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788263603.950481:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+5:2359:x1875129735995264:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263603.950517:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+5:2359:x1875129735995264:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 36us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263603.950523:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788263603.950536:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788263603.950541:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:2359:x1875129735994880:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263603.950561:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:2359:x1875129735994880:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 20us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263603.950579:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788263603.950592:0:19728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1788263603.950598:0:19728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99434623e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+5:2359:x1875129735995136:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788263603.950625:0:19728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99434623e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:35f00e73-0282-4959-b63a-fcd0dc77029e+5:2359:x1875129735995136:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 28us (2612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788263603.950630:0:19728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00080000:2.0:1788263603.952320:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788263603.952328:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788263603.952331:0:19036:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:2.0:1788263603.989340:0:21171:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788263603.989350:0:21171:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1788263603.989365:0:21171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc51395792f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.989378:0:21171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc51395792f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.989386:0:21171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc51395792f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.989393:0:21171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994376100400 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:2.0:1788263603.989398:0:21171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc51395792f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.989406:0:21171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc51395792f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.989441:0:21171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc51395792f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788263603.989448:0:21171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b9c533f/0x1a657bc51395792f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788263603.989562:0:21171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:42f281e6-4ca9-42e3-af58-12fb1244acb4+11:2361:x1875129735994624:12345-192.168.201.29@tcp:4:dd.0 Request processed in 61646us (430346us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788263603.989572:0:21171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000001:00080000:2.0:1788263603.989607:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901901 is committed 00010000:00010000:3.0:1788263603.992360:0:19733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc670383/0x1a657bc513957928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.992381:0:19733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc670383/0x1a657bc513957928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.992389:0:19733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc670383/0x1a657bc513957928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.992396:0:19733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff994343159800 already unused, calling callback (ffffffffc14d0230) 00010000:00010000:3.0:1788263603.992401:0:19733:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc670383/0x1a657bc513957928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.992408:0:19733:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc670383/0x1a657bc513957928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.992428:0:19733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc670383/0x1a657bc513957928 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788263603.992453:0:19733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc670383/0x1a657bc513957928 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788263603.992593:0:19733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9943509f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:42f281e6-4ca9-42e3-af58-12fb1244acb4+5:2361:x1875129735994368:12345-192.168.201.29@tcp:4:dd.0 Request processed in 107904us (433396us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788263603.992603:0:19733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00010000:00010000:2.0:1788263604.923414:0:20740:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788263605.733178:0:21210:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1788263605.947453:0:19029:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788263606.974557:0:19028:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9568 lines, 9568 kept, 0 dropped, 0 bad.