00010000:00010000:3.0F:1788361050.656229:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1788361051.689676:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361052.080680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0F:1788361052.080799:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130460800 00000100:00100000:1.0:1788361052.080820:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130460800 00000100:00100000:1.0:1788361052.080890:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:1.0:1788361052.080900:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+20:14353:x1875232130460800:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788361052.081001:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+20:14353:x1875232130460800:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 102us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361052.081020:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00080000:0.0:1788361052.081569:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361052.085417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361052.085460:0:14230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130461056 00000100:00100000:0.0:1788361052.085476:0:14230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130461056 00000100:00100000:0.0:1788361052.085537:0:14230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361052.085546:0:14230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+20:14353:x1875232130461056:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361052.086166:0:14230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+21:14353:x1875232130461056:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 617us (754us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788361052.086176:0:14230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361052.320617:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144064768:0@lo:400:kworker.0 00000100:00100000:0.0:1788361052.320695:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361052.320700:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144064896:0@lo:400:kworker.0 00000100:00100000:1.0:1788361052.320740:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361052.320748:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144065280:0@lo:400:kworker.0 00000100:00100000:1.0:1788361052.320769:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144065408:0@lo:400:kworker.0 00000100:00100000:0.0:1788361052.320788:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361052.320805:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361052.320818:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361052.320827:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144065152:0@lo:400:kworker.0 00000100:00100000:1.0:1788361052.320833:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361052.320841:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144065024:0@lo:400:kworker.0 00000100:00100000:0.0:1788361052.320874:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361052.320879:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361052.320920:0:15711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144064896 00000100:00100000:1.0:1788361052.320928:0:15711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144064896 00000100:00100000:0.0:1788361052.320933:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144065280 00000100:00100000:0.0:1788361052.320939:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144065280 00000100:00100000:2.0F:1788361052.321048:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144064768 00000100:00100000:2.0:1788361052.321065:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144064768 00000100:00100000:2.0:1788361052.321120:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788361052.321129:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf24b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3314:x1875232144064768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361052.321181:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf24b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3314:x1875232144064768:12345-0@lo:400:kworker.0 Request processed in 54us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361052.321188:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788361052.321222:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144065408 00000100:00100000:2.0:1788361052.321226:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144065408 00000100:00100000:3.0:1788361052.321335:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144065536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361052.321365:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361052.321397:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144065536 00000100:00100000:3.0:1788361052.321401:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144065536 00000100:00100000:3.0:1788361052.321428:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361052.321435:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144065536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361052.321464:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788361052.321500:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144065536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361052.321507:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361052.321529:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144065664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361052.321553:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361052.321898:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144065536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361052.323774:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144065664 00000100:00100000:3.0:1788361052.323787:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144065664 00000100:00100000:1.0:1788361052.323886:0:15711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144065024 00000100:00100000:1.0:1788361052.323890:0:15711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144065024 00000100:00100000:1.0:1788361052.323912:0:15711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788361052.323921:0:15711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144064896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361052.323995:0:15711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144064896:12345-0@lo:400:kworker.0 Request processed in 75us (3254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361052.324003:0:15711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788361052.324032:0:15711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361052.324038:0:15711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144065024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361052.324065:0:15711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144065024:12345-0@lo:400:kworker.0 Request processed in 28us (3188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361052.324082:0:15711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361052.324234:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144065152 00000100:00100000:0.0:1788361052.324239:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144065152 00000100:00100000:0.0:1788361052.324254:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788361052.324261:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144065280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361052.324299:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144065280:12345-0@lo:400:kworker.0 Request processed in 39us (3512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361052.324305:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788361052.324317:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361052.324330:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144065152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361052.324358:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144065152:12345-0@lo:400:kworker.0 Request processed in 29us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361052.324364:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361052.324413:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788361052.324419:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a89858aed80, transno 8589934595 00000004:00080000:0.0:1788361052.324430:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788361052.324449:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144065024:0@lo:400:kworker.0 00000100:00100000:0.0:1788361052.324463:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144064896:0@lo:400:kworker.0 00000100:00100000:0.0:1788361052.327591:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144065152:0@lo:400:kworker.0 00000100:00100000:0.0:1788361052.327606:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144064768:0@lo:400:kworker.0 00000100:00100000:0.0:1788361052.327616:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144065280:0@lo:400:kworker.0 00000100:00100000:2.0:1788361052.329507:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361052.329522:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144065408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361052.329626:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144065408:12345-0@lo:400:kworker.0 Request processed in 108us (8822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361052.329634:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361052.329681:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144065408:0@lo:400:kworker.0 00000100:00100000:3.0:1788361052.332659:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361052.332673:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144065664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361052.332708:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00080000:1.0:1788361052.332789:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361052.332794:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144065664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (11239us total) trans 0 rc 0/0 00000100:00080000:1.0:1788361052.332798:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361052.332803:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361052.332805:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361052.332863:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144065664:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788361052.371169:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788361052.371189:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a8837dd80 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:1.0:1788361052.371194:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a841c8700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a8837d300 00000020:00080000:1.0:1788361052.371198:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a841c8300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8986ff9400 00000020:00080000:0.0:1788361052.371345:0:14265:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:0.0:1788361052.371527:0:14265:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788361052.704379:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361053.729450:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361053.841563:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361053.841606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361053.841701:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130461184 00000100:00100000:3.0:1788361053.841712:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130461184 00000100:00100000:3.0:1788361053.841785:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:3.0:1788361053.841809:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:2352:x1875232130461184:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361053.841877:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:2352:x1875232130461184:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 71us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361053.841884:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:1.0:1788361053.842251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361053.842280:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361053.842321:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130461696 00000100:00100000:0.0:1788361053.842327:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130461696 00000100:00100000:0.0:1788361053.842381:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:0.0:1788361053.842389:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2352:x1875232130461696:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361053.842440:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2352:x1875232130461696:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 51us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361053.842446:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00080000:3.0:1788361053.842657:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361053.843179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361053.843210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361053.843246:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130461312 00000100:00100000:3.0:1788361053.843251:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130461312 00000100:00100000:3.0:1788361053.843293:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:3.0:1788361053.843301:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+12:2352:x1875232130461312:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361053.843348:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+12:2352:x1875232130461312:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361053.843354:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1788361053.843649:0:15711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130461440 00000100:00100000:2.0:1788361053.843654:0:15711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130461440 00000100:00100000:2.0:1788361053.843698:0:15711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130461952 00000100:00100000:2.0:1788361053.843701:0:15711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130461952 00000100:00100000:2.0:1788361053.843724:0:15711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361053.843731:0:15711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2352:x1875232130461440:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361053.843766:0:15711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2352:x1875232130461440:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 35us (2160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361053.843773:0:15711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361053.843786:0:15711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361053.843792:0:15711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2352:x1875232130461952:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361053.843817:0:15711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2352:x1875232130461952:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 26us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361053.843835:0:15711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00080000:3.0:1788361053.844101:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361053.844105:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361053.844731:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361053.844815:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130461568 00000100:00100000:3.0:1788361053.844821:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130461568 00000100:00100000:3.0:1788361053.844865:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130461824 00000100:00100000:3.0:1788361053.844869:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130461824 00000100:00100000:3.0:1788361053.844887:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361053.844895:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2352:x1875232130461568:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361053.844955:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2352:x1875232130461568:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 60us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361053.844971:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361053.844985:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:3.0:1788361053.844990:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2352:x1875232130461824:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361053.845022:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2352:x1875232130461824:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361053.845038:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00080000:1.0:1788361053.845532:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361053.845537:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788361054.754039:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361055.777836:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361056.808554:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361057.442258:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144065792:0@lo:400:kworker.0 00000100:00100000:3.0:1788361057.442343:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144066176:0@lo:400:kworker.0 00000100:00100000:0.0:1788361057.442352:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361057.442394:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361057.442420:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144066304:0@lo:400:kworker.0 00000100:00100000:3.0:1788361057.442436:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144065920:0@lo:400:kworker.0 00000100:00100000:0.0:1788361057.442449:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361057.442472:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361057.442491:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144066176 00000100:00100000:3.0:1788361057.442496:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144066432:0@lo:400:kworker.0 00000100:00100000:0.0:1788361057.442499:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144066176 00000100:00100000:3.0:1788361057.442520:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361057.442538:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788361057.442545:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144066048:0@lo:400:kworker.0 00000100:00100000:0.0:1788361057.442547:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144066304 00000100:00100000:0.0:1788361057.442551:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144066304 00000100:00100000:3.0:1788361057.442570:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361057.442580:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144066432 00000100:00100000:0.0:1788361057.442584:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144066432 00000100:00100000:3.0:1788361057.442594:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144066560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361057.442605:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361057.442615:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144066176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361057.442620:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361057.442651:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144065792 00000100:00100000:3.0:1788361057.442656:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144065792 00000100:00100000:0.0:1788361057.442692:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144066176:12345-0@lo:400:kworker.0 Request processed in 77us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361057.442694:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788361057.442704:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf24a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3314:x1875232144065792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361057.442715:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361057.442739:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361057.442747:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144066304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361057.442752:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf24a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3314:x1875232144065792:12345-0@lo:400:kworker.0 Request processed in 46us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361057.442760:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788361057.442793:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788361057.442800:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144066304:12345-0@lo:400:kworker.0 Request processed in 54us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361057.442805:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144066432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361057.442813:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788361057.442836:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361057.442847:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144066432:12345-0@lo:400:kworker.0 Request processed in 45us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361057.442868:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788361057.442889:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144065920 00000100:00100000:3.0:1788361057.442892:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144065920 00000100:00100000:3.0:1788361057.442924:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144066048 00000100:00100000:3.0:1788361057.442927:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144066048 00000100:00100000:3.0:1788361057.442945:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361057.442951:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144065920:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788361057.442956:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361057.442960:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361057.442996:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144065920:12345-0@lo:400:kworker.0 Request processed in 45us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361057.443002:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361057.443015:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361057.443021:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144066048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361057.443047:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144066048:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361057.443052:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361057.443082:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144066560 00000100:00100000:3.0:1788361057.443114:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144066560 00000100:00100000:3.0:1788361057.443152:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361057.443159:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144066560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361057.443187:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788361057.443219:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144066560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361057.443225:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361057.443514:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144066688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361057.443540:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361057.443571:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144066176:0@lo:400:kworker.0 00000100:00100000:3.0:1788361057.443600:0:16006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144066688 00000100:00100000:3.0:1788361057.443603:0:16006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144066688 00000100:00100000:3.0:1788361057.443623:0:16006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788361057.443628:0:16006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144066688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361057.443645:0:16006:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361057.443675:0:16006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144066688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361057.443680:0:16006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788361057.443706:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144066688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361057.443725:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144066048:0@lo:400:kworker.0 00000100:00100000:3.0:1788361057.443737:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144066560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361057.443745:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144065920:0@lo:400:kworker.0 00000100:00100000:3.0:1788361057.443752:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144066432:0@lo:400:kworker.0 00000100:00100000:3.0:1788361057.443777:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144066304:0@lo:400:kworker.0 00000100:00100000:3.0:1788361057.443785:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144065792:0@lo:400:kworker.0 00000020:00080000:1.0:1788361057.502816:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:2.0:1788361057.502878:0:14265:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000020:00080000:2.0:1788361057.502888:0:14265:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00010000:00010000:0.0:1788361057.824909:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361058.849458:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361058.957484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361058.957529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361058.957628:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130462208 00000100:00100000:1.0:1788361058.957638:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130462208 00000100:00100000:1.0:1788361058.957711:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361058.957721:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+12:2351:x1875232130462208:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361058.957793:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+12:2351:x1875232130462208:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 74us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361058.957801:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00080000:2.0:1788361058.957955:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361058.958171:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130462080 00000100:00100000:0.0:1788361058.958186:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130462080 00000100:00100000:0.0:1788361058.958258:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:0.0:1788361058.958272:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf24ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:2351:x1875232130462080:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361058.958374:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf24ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:2351:x1875232130462080:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 106us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361058.958383:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:2.0:1788361058.960467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361058.960506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361058.960580:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130462592 00000100:00100000:3.0:1788361058.960589:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130462592 00000100:00080000:2.0:1788361058.960672:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361058.960776:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:3.0:1788361058.960788:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2352:x1875232130462592:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361058.960809:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130462464 00000100:00100000:0.0:1788361058.960822:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130462464 00000100:00100000:3.0:1788361058.960868:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2352:x1875232130462592:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 82us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361058.960882:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788361058.960928:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788361058.960942:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2352:x1875232130462464:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361058.961019:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2352:x1875232130462464:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361058.961027:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00080000:2.0:1788361058.961162:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361058.963694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361058.963741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361058.963836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361058.964434:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130462336 00000100:00100000:3.0:1788361058.964437:0:15711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130462720 00000100:00100000:0.0:1788361058.964451:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130462336 00000100:00100000:3.0:1788361058.964456:0:15711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130462720 00000100:00100000:3.0:1788361058.964550:0:15711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130462848 00000100:00100000:3.0:1788361058.964554:0:15711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130462848 00000100:00100000:0.0:1788361058.964572:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361058.964603:0:15711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:0.0:1788361058.964606:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2348:x1875232130462720:12345-192.168.203.60@tcp:9:kworker.0 00000100:00100000:3.0:1788361058.964623:0:15711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2348:x1875232130462336:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1788361058.964656:0:14865:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661165a 00000020:00000080:3.0:1788361058.964669:0:15711:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611629 00000100:00080000:0.0:1788361058.964682:0:14865:0:(import.c:65:import_set_state_nolock()) ffff9a8a8438e800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788361058.965076:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361058.965137:0:15711:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4b800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788361058.968986:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361058.969003:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1788361058.969100:0:14865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:1.0:1788361058.969723:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361058.969923:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+2:2348:x1875232130462720:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 5329us (6171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361058.969938:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1788361058.969989:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788361058.970002:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+5:2348:x1875232130462848:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1788361058.970039:0:14865:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611661 00000100:00080000:0.0:1788361058.970055:0:14865:0:(import.c:65:import_set_state_nolock()) ffff9a8a84389000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361058.970115:0:14865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:0.0:1788361058.970331:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+2:2348:x1875232130462848:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 332us (6493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361058.970338:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00010000:00010000:0.0:1788361058.970360:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788361058.970623:0:15711:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788361058.970833:0:15711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b731a8db-84ff-4db6-8c11-a2dda6e4d993+2:2348:x1875232130462336:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 6211us (7146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361058.970845:0:15711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000001:00100000:1.0:1788361059.014118:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a6c7f1e-7137-478a-bebd-d5781dcb5c03 00000020:00000080:1.0:1788361059.014128:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8a83e48800/6a6c7f1e-7137-478a-bebd-d5781dcb5c03 00000001:00100000:1.0:1788361059.014149:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b731a8db-84ff-4db6-8c11-a2dda6e4d993 00000020:00000080:1.0:1788361059.014152:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8a83e4c000/b731a8db-84ff-4db6-8c11-a2dda6e4d993 00000020:00000080:0.0:1788361059.014194:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83e48800/6a6c7f1e-7137-478a-bebd-d5781dcb5c03 for lustre-OST0000 00000020:00000080:0.0:1788361059.014257:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83e4c000/b731a8db-84ff-4db6-8c11-a2dda6e4d993 for lustre-OST0000 00000020:00000080:0.0:1788361059.014272:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8438e800 for lustre-OST0000 00000020:00000080:0.0:1788361059.014275:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a83e4b800 for lustre-OST0000 00000040:00080000:3.0:1788361059.424357:0:14260:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788361059.424366:0:14260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361059.424406:0:14260:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788361059.424412:0:14260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788361059.872721:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788361060.021792:0:17073:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 10:57:39 (1788361059) 00010000:00010000:1.0:1788361060.896248:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361061.921815:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361062.560378:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144066816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361062.560452:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361062.563254:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144066944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361062.567139:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b97d369-4bf1-43ee-a977-45b88f10e003:3312:1875232144067072:0@lo:400:kworker.0 00000100:00100000:2.0:1788361062.567214:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361062.567275:0:14220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144067072 00000100:00100000:2.0:1788361062.567282:0:14220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144067072 00000100:00100000:2.0:1788361062.567314:0:14220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788361062.567320:0:14220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3312:x1875232144067072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361062.567357:0:14220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3312:x1875232144067072:12345-0@lo:400:kworker.0 Request processed in 37us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361062.567361:0:14220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788361062.567395:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b97d369-4bf1-43ee-a977-45b88f10e003:3312:1875232144067072:0@lo:400:kworker.0 00000100:00100000:1.0:1788361062.570110:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144067584:0@lo:400:kworker.0 00000100:00100000:1.0:1788361062.570181:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361062.570218:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361062.570225:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144067456:0@lo:400:kworker.0 00000100:00100000:1.0:1788361062.570247:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361062.570277:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144067584 00000100:00100000:1.0:1788361062.570284:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144067584 00000100:00100000:1.0:1788361062.570338:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144067456 00000100:00100000:1.0:1788361062.570341:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144067456 00000100:00100000:1.0:1788361062.570362:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788361062.570369:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144067584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361062.570423:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144067584:12345-0@lo:400:kworker.0 Request processed in 54us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361062.570431:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788361062.570455:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361062.570465:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144067456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361062.570565:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144067456:12345-0@lo:400:kworker.0 Request processed in 102us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361062.570571:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788361062.570593:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361062.570627:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144067456:0@lo:400:kworker.0 00000100:00100000:1.0:1788361062.570652:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144067584:0@lo:400:kworker.0 00000100:00100000:2.0:1788361062.570754:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144067200:0@lo:400:kworker.0 00000100:00100000:2.0:1788361062.570796:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361062.570825:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144067712:0@lo:400:kworker.0 00000100:00100000:2.0:1788361062.570848:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361062.570864:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361062.570870:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144067328:0@lo:400:kworker.0 00000100:00100000:1.0:1788361062.570928:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144067200 00000100:00100000:1.0:1788361062.570933:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144067200 00000100:00100000:1.0:1788361062.570975:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788361062.570982:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144067200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361062.571017:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361062.571056:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144067328 00000100:00100000:2.0:1788361062.571060:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144067328 00000100:00100000:2.0:1788361062.571103:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788361062.571111:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144067328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361062.571146:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144067328:12345-0@lo:400:kworker.0 Request processed in 37us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361062.571153:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788361062.571180:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144067328:0@lo:400:kworker.0 00000100:00100000:2.0:1788361062.571197:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361062.573592:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144066816 00000100:00100000:3.0:1788361062.573607:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144066816 00000100:00100000:3.0:1788361062.573696:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361062.573709:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144066816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361062.573759:0:14866:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788361062.573831:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144066816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (13378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361062.573839:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788361062.573906:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361062.573923:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361062.573936:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144067712 00000100:00100000:3.0:1788361062.573952:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144067712 00000100:00100000:3.0:1788361062.573993:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788361062.574000:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144067712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361062.574045:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144067712:12345-0@lo:400:kworker.0 Request processed in 45us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361062.574051:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788361062.574064:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361062.574123:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144067712:0@lo:400:kworker.0 00000100:00100000:3.0:1788361062.576120:0:14867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144066944 00000100:00100000:3.0:1788361062.576130:0:14867:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144066944 00000100:00100000:3.0:1788361062.576181:0:14867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788361062.576190:0:14867:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144066944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361062.576220:0:14867:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 68091904 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361062.576274:0:14867:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144066944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (5075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361062.576280:0:14867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361062.577009:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144066816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361062.577134:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144067200:12345-0@lo:400:kworker.0 Request processed in 6150us (6335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361062.577144:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788361062.577233:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144066944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361062.577313:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144067200:0@lo:400:kworker.0 00000100:00100000:3.0:1788361062.845338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361062.845495:0:14229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130463104 00000100:00100000:2.0:1788361062.845505:0:14229:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130463104 00000100:00100000:2.0:1788361062.845583:0:14229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361062.845593:0:14229:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+12:15235:x1875232130463104:12345-192.168.203.60@tcp:35:umount.0 00000001:00080000:2.0:1788361062.845957:0:14229:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:2.0:1788361062.846081:0:14229:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:15235:x1875232130463104:12345-192.168.203.60@tcp:35:umount.0 Request processed in 489us (750us total) trans 8589934625 rc 0/0 00000100:00100000:2.0:1788361062.846127:0:14229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000020:00080000:2.0:1788361062.846138:0:14229:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1788361062.846540:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361062.852897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361062.852954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361062.852991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361062.853034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361062.853118:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130463616 00000100:00100000:1.0:1788361062.853133:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130463616 00000100:00100000:1.0:1788361062.853219:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788361062.853229:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2348:x1875232130463616:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:1.0:1788361062.853273:0:14865:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611622 00000100:00080000:1.0:1788361062.853281:0:14865:0:(import.c:65:import_set_state_nolock()) ffff9a8a86759000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361062.853314:0:14865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:1.0:1788361062.853525:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+2:2348:x1875232130463616:12345-192.168.203.60@tcp:9:umount.0 Request processed in 297us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361062.853533:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1788361062.853711:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130463232 00000100:00100000:3.0:1788361062.853716:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130463232 00000100:00100000:3.0:1788361062.853764:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130463488 00000100:00100000:3.0:1788361062.853767:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130463488 00000100:00100000:3.0:1788361062.853785:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130463360 00000100:00100000:3.0:1788361062.853788:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130463360 00000100:00100000:3.0:1788361062.853801:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:3.0:1788361062.853821:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:959e9e7f-774e-4361-b4b5-5ac0edf42466+15:2349:x1875232130463232:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361062.853832:0:16251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361062.853851:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611606 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5b0 expref: 15 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361062.853865:0:16251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361062.853886:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:959e9e7f-774e-4361-b4b5-5ac0edf42466+14:2349:x1875232130463232:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 66us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361062.853892:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:3.0:1788361062.853906:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361062.853911:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8927d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:959e9e7f-774e-4361-b4b5-5ac0edf42466+13:2349:x1875232130463488:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361062.853919:0:16251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361062.853929:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d66116ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e67b expref: 13 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361062.853946:0:16251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361062.853967:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8927d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:2349:x1875232130463488:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 55us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361062.853973:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361062.854013:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361062.854018:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:2349:x1875232130463360:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361062.854025:0:16251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361062.854037:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1ea00/0xf6a94c97d661160d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5da expref: 11 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361062.854045:0:16251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361062.854071:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:2349:x1875232130463360:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 52us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361062.854081:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00010000:00010000:3.0:1788361062.854138:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361062.854280:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361062.866570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361062.866719:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130464512 00000100:00100000:3.0:1788361062.866729:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130464512 00000100:00100000:3.0:1788361062.866790:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:3.0:1788361062.866799:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+14:2348:x1875232130464512:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:3.0:1788361062.866832:0:14228:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661161b 00000020:00010000:3.0:1788361062.866845:0:14228:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a83e48000: total 0 00000100:00080000:3.0:1788361062.866849:0:14228:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361062.866876:0:14228:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000020:00010000:0.0:1788361062.867343:0:15712:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a83e48000: total 0 00010000:00010000:0.0:1788361062.867349:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361062.867392:0:15712:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a83e48000, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1788361062.867424:0:15712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:0.0:1788361062.867429:0:15712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361062.867438:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac06c9a00/0xf6a94c97d6611844 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6f9 expref: 14 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361062.867457:0:15712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a983bf600) 00010000:00010000:0.0:1788361062.867460:0:15712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361062.867463:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42c00/0xf6a94c97d66116e6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e689 expref: 13 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361062.867482:0:15712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bfe00) 00010000:00010000:0.0:1788361062.867498:0:15712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361062.867503:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8c42e00/0xf6a94c97d661171e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e697 expref: 12 pid: 16168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361062.867519:0:15712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:0.0:1788361062.867521:0:15712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361062.867525:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d66116ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e682 expref: 11 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361062.867539:0:15712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a8aa8ee1200) 00010000:00010000:0.0:1788361062.867542:0:15712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788361062.867546:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66117a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6c1 expref: 10 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361062.867559:0:15712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a8a983bfd00) 00010000:00010000:0.0:1788361062.867562:0:15712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361062.867566:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6611821 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e6eb expref: 9 pid: 14228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361062.867580:0:15712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:0.0:1788361062.867582:0:15712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361062.867585:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661189f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e70e expref: 8 pid: 14226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361062.867596:0:15712:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a83e48000, canceled 7 locks, left on hash table 0. 00010000:00010000:0.0:1788361062.867608:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361062.867610:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361062.867612:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361062.868433:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b731a8db-84ff-4db6-8c11-a2dda6e4d993+5:2348:x1875232130464512:12345-192.168.203.60@tcp:39:umount.0 Request processed in 1631us (1868us total) trans 8589934626 rc 0/0 00000100:00100000:3.0:1788361062.868444:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00010000:00010000:0.0:1788361062.944398:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788361063.112050:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a6c7f1e-7137-478a-bebd-d5781dcb5c03 00000020:00000080:3.0:1788361063.112060:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8a8438d800/6a6c7f1e-7137-478a-bebd-d5781dcb5c03 00000001:00100000:3.0:1788361063.112080:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b731a8db-84ff-4db6-8c11-a2dda6e4d993 00000020:00000080:3.0:1788361063.112082:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8a86759800/b731a8db-84ff-4db6-8c11-a2dda6e4d993 00000020:00000080:1.0:1788361063.112231:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8438d800/6a6c7f1e-7137-478a-bebd-d5781dcb5c03 for lustre-OST0001 00000020:00000080:1.0:1788361063.112479:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a86759800/b731a8db-84ff-4db6-8c11-a2dda6e4d993 for lustre-OST0001 00000020:00000080:1.0:1788361063.112582:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a84389000 for lustre-OST0001 00000020:00000080:1.0:1788361063.112603:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a86759000 for lustre-OST0001 00010000:00010000:3.0:1788361063.968513:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361064.072950:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361064.072996:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361064.073066:0:16168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130464768 00000100:00100000:0.0:1788361064.073076:0:16168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130464768 00000100:00100000:2.0:1788361064.073122:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130464640 00000100:00100000:2.0:1788361064.073128:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130464640 00000100:00100000:0.0:1788361064.073168:0:16168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1788361064.073169:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:0.0:1788361064.073183:0:16168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2351:x1875232130464768:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361064.073184:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf24a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:2351:x1875232130464640:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361064.073269:0:16168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2351:x1875232130464768:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00080000:3.0:1788361064.073273:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361064.073279:0:16168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1788361064.073726:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf24a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:2351:x1875232130464640:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 546us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361064.073734:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:1.0:1788361064.476655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361064.476692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361064.476727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361064.476815:0:14213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130464896 00000100:00100000:0.0:1788361064.476818:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130465152 00000100:00100000:2.0:1788361064.476826:0:14213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130464896 00000100:00100000:0.0:1788361064.476826:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130465152 00000100:00100000:3.0:1788361064.476892:0:16251:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130465024 00000100:00100000:3.0:1788361064.476896:0:16251:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130465024 00000100:00100000:0.0:1788361064.476957:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361064.476967:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:959e9e7f-774e-4361-b4b5-5ac0edf42466+12:2351:x1875232130465152:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361064.476982:0:14211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361064.477001:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66116a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e674 expref: 12 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361064.477017:0:14211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361064.477068:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:2351:x1875232130465152:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361064.477076:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788361064.477521:0:14213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1788361064.477531:0:14213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:959e9e7f-774e-4361-b4b5-5ac0edf42466+11:2351:x1875232130464896:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361064.477540:0:14213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361064.477551:0:14213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d661163e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e612 expref: 11 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361064.477562:0:14213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361064.477588:0:14213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:959e9e7f-774e-4361-b4b5-5ac0edf42466+10:2351:x1875232130464896:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 60us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361064.477595:0:14213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788361064.480791:0:16251:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361064.480809:0:16251:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:959e9e7f-774e-4361-b4b5-5ac0edf42466+9:2351:x1875232130465024:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361064.480838:0:16251:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361064.480858:0:16251:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ac06c9000/0xf6a94c97d6611645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e63c expref: 9 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361064.480873:0:16251:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361064.480943:0:16251:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:959e9e7f-774e-4361-b4b5-5ac0edf42466+8:2351:x1875232130465024:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 140us (4214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361064.480951:0:16251:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361064.488256:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361064.488407:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130465408 00000100:00100000:2.0:1788361064.488419:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130465408 00000100:00100000:2.0:1788361064.488477:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:2.0:1788361064.488487:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+6:2348:x1875232130465408:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:2.0:1788361064.488526:0:14227:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611653 00000020:00010000:2.0:1788361064.488536:0:14227:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8ab6fbf000: total 0 00000100:00080000:2.0:1788361064.488540:0:14227:0:(import.c:65:import_set_state_nolock()) ffff9a8ab6fbf800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788361064.488580:0:14227:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:0.0:1788361064.488867:0:15712:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8ab6fbf000: total 0 00010000:00010000:0.0:1788361064.488912:0:15712:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8ab6fbf000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788361064.488957:0:15712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983bfe00) 00010000:00010000:0.0:1788361064.488961:0:15712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361064.488969:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661172c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e69e expref: 5 pid: 14227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361064.488990:0:15712:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8ab6fbf000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788361064.489008:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361064.489010:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361064.489011:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361064.489174:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a6c7f1e-7137-478a-bebd-d5781dcb5c03+3:2348:x1875232130465408:12345-192.168.203.60@tcp:39:umount.0 Request processed in 687us (926us total) trans 8589934627 rc 0/0 00000100:00100000:2.0:1788361064.489183:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:1.0:1788361064.507421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361064.508315:0:14218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130465664 00000100:00100000:2.0:1788361064.508327:0:14218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130465664 00000100:00100000:2.0:1788361064.508391:0:14218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:2.0:1788361064.508401:0:14218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+7:2348:x1875232130465664:12345-192.168.203.60@tcp:251:umount.0 00000020:00000080:2.0:1788361064.508457:0:14218:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66115f8 00000020:00010000:2.0:1788361064.508464:0:14218:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8ab76d9800: total 0 00000100:00080000:2.0:1788361064.508469:0:14218:0:(import.c:65:import_set_state_nolock()) ffff9a8ab76db800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788361064.508544:0:14218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:959e9e7f-774e-4361-b4b5-5ac0edf42466+3:2348:x1875232130465664:12345-192.168.203.60@tcp:251:umount.0 Request processed in 144us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361064.508552:0:14218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 126 00000020:00010000:0.0:1788361064.509042:0:14215:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8ab76d9800: total 0 00010000:00010000:0.0:1788361064.509127:0:14215:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8ab76d9800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788361064.509159:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1fa00/0xf6a94c97d66115ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e5a9 expref: 2 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361064.509175:0:14215:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8ab76d9800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788361064.509185:0:14215:0:(genops.c:906:class_export_put()) final put ffff9a8ab76d9800/959e9e7f-774e-4361-b4b5-5ac0edf42466 00010000:00010000:0.0:1788361064.509207:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361064.509210:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361064.509212:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361064.509612:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76d9800/959e9e7f-774e-4361-b4b5-5ac0edf42466 for MGS 00000020:00000080:2.0:1788361064.509651:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ab76db800 for MGS 00010000:00010000:3.0:1788361064.994692:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788361065.867244:0:17267:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788361065.882235:0:17267:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788361065.882288:0:17267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.882302:0:17267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.882310:0:17267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.882317:0:17267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.882339:0:17267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788361065.882344:0:17267:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788361065.882370:0:17267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361065.882375:0:17267:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788361065.882381:0:17267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788361065.882404:0:17267:0:(import.c:65:import_set_state_nolock()) ffff9a8a83cfa800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788361065.882514:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144067840:0@lo:39:umount.0 00000100:00100000:3.0:1788361065.882582:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361065.882751:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361065.882758:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.882765:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705bc00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361065.882769:0:15712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.882778:0:15712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361065.882785:0:15712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361065.882791:0:15712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788361065.882794:0:15712:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788361065.882796:0:15712:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788361065.882820:0:15712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.882839:0:15712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361065.882867:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.882874:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab705bc00/0xf6a94c97d6611327 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661132e expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.882884:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361065.882886:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361065.882888:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361065.882895:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361065.882904:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b97d369-4bf1-43ee-a977-45b88f10e003:3313:1875232144067968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361065.882946:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361065.883066:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144067968 00000100:00100000:0.0:1788361065.883073:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144067968 00000100:00100000:0.0:1788361065.883153:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361065.883162:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3313:x1875232144067968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361065.883175:0:14212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361065.883190:0:14212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586b600/0xf6a94c97d661132e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6611327 expref: 19 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.883202:0:14212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361065.883239:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b97d369-4bf1-43ee-a977-45b88f10e003+18:3313:x1875232144067968:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361065.883247:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361065.883285:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7b97d369-4bf1-43ee-a977-45b88f10e003:3313:1875232144067968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361065.883361:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144067840 00000100:00100000:1.0:1788361065.883366:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144067840 00000100:00100000:1.0:1788361065.883401:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788361065.883408:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875232144067840:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788361065.883439:0:14226:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611358 00000100:00080000:1.0:1788361065.883448:0:14226:0:(import.c:65:import_set_state_nolock()) ffff9a8a8337f800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788361065.883499:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1875232144067840:12345-0@lo:39:umount.0 Request processed in 91us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361065.883536:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:00000080:1.0:1788361065.883544:0:14226:0:(genops.c:906:class_export_put()) final put ffff9a8a8337c800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1788361065.883626:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a83cfa800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788361065.883645:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144067840:0@lo:39:umount.0 00000020:00000080:3.0:1788361065.883665:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8337c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788361065.883712:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8337f800 for lustre-MDT0000 00000100:00080000:1.0:1788361065.883759:0:17267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361065.883763:0:17267:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788361065.883767:0:17267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788361065.884756:0:17267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884770:0:17267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884777:0:17267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884784:0:17267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884815:0:17267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361065.884822:0:17267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884828:0:17267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884834:0:17267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884848:0:17267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884860:0:17267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361065.884867:0:17267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884872:0:17267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884878:0:17267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884884:0:17267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884892:0:17267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788361065.884896:0:17267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884903:0:17267:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884908:0:17267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884924:0:17267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361065.884943:0:17267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788361065.884946:0:17267:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788361065.884975:0:17267:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788361065.884979:0:17267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788361065.884982:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361065.884987:0:17267:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1788361065.884993:0:17267:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a8a85daf000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361065.884998:0:17267:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a8ab76de000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361065.885006:0:17267:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9a8ab6fbf000 6a6c7f1e-7137-478a-bebd-d5781dcb5c03 192.168.203.60@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1788361065.885012:0:17267:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9a8a83e48000 b731a8db-84ff-4db6-8c11-a2dda6e4d993 192.168.203.60@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:1.0:1788361065.885017:0:17267:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9a8a84f13380) has exports, disconnecting them 00000020:00080000:1.0:1788361065.885021:0:17267:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a8a85daf000), last request at 1788361062 00000020:00000080:1.0:1788361065.885028:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661144d 00000100:00080000:1.0:1788361065.885047:0:17267:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48c000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788361065.885114:0:17267:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a85daf000): rc 0 00000020:00000080:1.0:1788361065.885118:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8a85daf000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788361065.885127:0:17267:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a8ab76de000), last request at 1788361062 00000020:00000080:1.0:1788361065.885131:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66113dd 00000100:00080000:1.0:1788361065.885136:0:17267:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efce800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788361065.885141:0:17267:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8ab76de000): rc 0 00000020:00000080:1.0:1788361065.885143:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8ab76de000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788361065.885149:0:17267:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa998c44c7ae0 00000100:00080000:1.0:1788361065.885167:0:17267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788361065.885170:0:17267:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:1.0:1788361065.885179:0:17267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788361065.885236:0:17267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788361065.885264:0:17267:0:(import.c:65:import_set_state_nolock()) ffff9a8aae465800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788361065.885279:0:17267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788361065.885281:0:17267:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 3 00000004:00080000:1.0:1788361065.885292:0:17267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788361065.885349:0:17267:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788361065.885358:0:17267:0:(import.c:65:import_set_state_nolock()) ffff9a8abf244000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788361065.885387:0:17267:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a8a84f13380) has no exports 00010000:00010000:0.0:1788361065.885503:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788361065.885517:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885525:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c42a00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361065.885529:0:14215:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885537:0:14215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361065.885544:0:14215:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361065.885550:0:14215:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788361065.885552:0:14215:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788361065.885554:0:14215:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788361065.885576:0:14215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885582:0:14215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361065.885599:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885606:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c42a00/0xf6a94c97d661128d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611294 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885618:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788361065.885621:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885626:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586a200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361065.885635:0:14215:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885641:0:14215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361065.885647:0:14215:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361065.885652:0:14215:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788361065.885654:0:14215:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788361065.885655:0:14215:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788361065.885668:0:14215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885674:0:14215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361065.885680:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885686:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586a200/0xf6a94c97d661145b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611462 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885699:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361065.885702:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885708:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9e00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361065.885711:0:14215:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885717:0:14215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361065.885730:0:14215:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361065.885735:0:14215:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788361065.885737:0:14215:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788361065.885739:0:14215:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788361065.885752:0:14215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885758:0:14215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361065.885772:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885779:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9e00/0xf6a94c97d6611699 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66116a0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885787:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361065.885790:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885796:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8c43600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361065.885799:0:14215:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885805:0:14215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361065.885811:0:14215:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361065.885827:0:14215:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788361065.885829:0:14215:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788361065.885831:0:14215:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788361065.885844:0:14215:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885849:0:14215:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361065.885855:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885861:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43600/0xf6a94c97d661127f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611286 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.885873:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361065.885875:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361065.885877:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361065.885898:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b97d369-4bf1-43ee-a977-45b88f10e003:3312:1875232144068480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361065.885974:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361065.886022:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361065.886029:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b97d369-4bf1-43ee-a977-45b88f10e003:3312:1875232144068352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361065.886052:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361065.886075:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144068736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361065.886124:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361065.886147:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361065.886153:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144068608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361065.886175:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361065.886201:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144068480 00000100:00100000:0.0:1788361065.886214:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144068480 00000100:00100000:0.0:1788361065.886254:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144068352 00000100:00100000:0.0:1788361065.886257:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144068352 00000100:00100000:0.0:1788361065.886268:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144068736 00000100:00100000:0.0:1788361065.886271:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144068736 00000100:00100000:0.0:1788361065.886282:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144068608 00000100:00100000:0.0:1788361065.886284:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144068608 00000100:00100000:0.0:1788361065.886299:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361065.886305:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+21:3312:x1875232144068480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361065.886318:0:14211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361065.886331:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ab705ba00/0xf6a94c97d6611462 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661145b expref: 21 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.886347:0:14211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361065.886381:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+20:3312:x1875232144068480:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361065.886388:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361065.886405:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788361065.886411:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8927f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+19:3312:x1875232144068352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361065.886419:0:14211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361065.886427:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586b000/0xf6a94c97d6611294 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661128d expref: 19 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.886436:0:14211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361065.886456:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8927f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+18:3312:x1875232144068352:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361065.886463:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788361065.886493:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361065.886498:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+17:3314:x1875232144068736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361065.886509:0:14211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361065.886517:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586a800/0xf6a94c97d6611286 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661127f expref: 17 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.886527:0:14211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361065.886551:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+16:3314:x1875232144068736:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361065.886557:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361065.886569:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788361065.886574:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+15:3314:x1875232144068608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361065.886581:0:14211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361065.886589:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ac06c8400/0xf6a94c97d66116a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6611699 expref: 15 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361065.886596:0:14211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361065.886614:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b97d369-4bf1-43ee-a977-45b88f10e003+14:3314:x1875232144068608:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361065.886620:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788361065.886651:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144068608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361065.886658:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144068736:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361065.886678:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361065.886690:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b97d369-4bf1-43ee-a977-45b88f10e003:3312:1875232144068352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361065.886698:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7b97d369-4bf1-43ee-a977-45b88f10e003:3312:1875232144068480:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361065.886778:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788361065.886788:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85daf000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788361065.886824:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76de000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788361065.886843:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8abc48c000 for lustre-MDT0000 00000020:00000080:3.0:1788361065.886847:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a9efce800 for lustre-MDT0000 00000100:00100000:3.0:1788361065.886863:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144068096:0@lo:9:umount.0 00000100:00100000:3.0:1788361065.886896:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361065.886935:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144068224:0@lo:9:umount.0 00000100:00100000:3.0:1788361065.886957:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361065.886986:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144068096 00000100:00100000:3.0:1788361065.886996:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144068096 00000100:00100000:3.0:1788361065.887030:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144068224 00000100:00100000:3.0:1788361065.887032:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144068224 00000100:00100000:3.0:1788361065.887053:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788361065.887059:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875232144068096:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788361065.887145:0:14864:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611469 00000100:00080000:3.0:1788361065.887154:0:14864:0:(import.c:65:import_set_state_nolock()) ffff9a8ac1c6f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361065.887184:0:14864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788361065.887518:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3310:x1875232144068096:12345-0@lo:9:umount.0 Request processed in 458us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361065.887525:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788361065.887539:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788361065.887545:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875232144068224:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788361065.887558:0:14864:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611470 00000100:00080000:3.0:1788361065.887563:0:14864:0:(import.c:65:import_set_state_nolock()) ffff9a8ac1c6e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361065.887580:0:14864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:3.0:1788361065.887758:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3310:x1875232144068224:12345-0@lo:9:umount.0 Request processed in 213us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361065.887764:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788361065.887780:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361065.887784:0:14222:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361065.887808:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8aae465800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788361065.887818:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788361065.887820:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361065.887824:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144068096:0@lo:9:umount.0 00000100:00080000:3.0:1788361065.887833:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8abf244000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788361065.887837:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788361065.887838:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361065.887840:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144068224:0@lo:9:umount.0 00010000:00010000:0.0:1788361065.888423:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361065.888429:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788361065.897454:0:17267:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a8a84f13380) has no exports 00000020:00000080:3.0:1788361065.956346:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66112da 00000020:00000080:3.0:1788361065.956362:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8a8986f800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788361065.956400:0:17267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788361065.956502:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8986f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788361065.956527:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361065.956536:0:17267:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788361065.956540:0:17267:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9a8a84f119c0) has no exports 00000020:00000080:2.0:1788361065.957621:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66112d3 00000020:00000080:2.0:1788361065.957630:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8abf241000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788361065.957694:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361065.957704:0:17267:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788361065.957706:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8abf245800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788361065.957709:0:17267:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abf245800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788361065.957713:0:17267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788361065.957982:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abf241000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788361066.019464:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361067.043186:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361067.680572:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144069120:0@lo:400:kworker.0 00000100:00100000:3.0:1788361067.680663:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361067.680741:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144069120 00000100:00100000:3.0:1788361067.680749:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144069120 00000100:00100000:3.0:1788361067.680792:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788361067.680800:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875232144069120:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788361067.680808:0:14228:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788361067.680870:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1875232144069120:12345-0@lo:400:kworker.0 Request processed in 67us (206us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361067.680878:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788361067.680938:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361067.680943:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efc8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788361067.680948:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788361067.681250:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144068864:0@lo:400:kworker.0 00000100:00100000:2.0:1788361067.681303:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361067.681332:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361067.681340:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144068992:0@lo:400:kworker.0 00000100:00100000:2.0:1788361067.681368:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361067.681409:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144068992 00000100:00100000:2.0:1788361067.681413:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144068992 00000100:00100000:2.0:1788361067.681441:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788361067.681447:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875232144068992:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788361067.681453:0:14227:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361067.681557:0:14221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144068864 00000100:00100000:0.0:1788361067.681563:0:14221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144068864 00000100:00100000:0.0:1788361067.681613:0:14221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788361067.681622:0:14221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+14:3311:x1875232144068864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361067.681669:0:14221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7b97d369-4bf1-43ee-a977-45b88f10e003+14:3311:x1875232144068864:12345-0@lo:400:kworker.0 Request processed in 50us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361067.681675:0:14221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788361067.681777:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875232144068992:12345-0@lo:400:kworker.0 Request processed in 328us (408us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361067.681785:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788361067.681816:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788361067.681821:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9a8a89248000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788361067.681824:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788361067.681830:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9a8a89248000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361067.681836:0:3311:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 407 00000100:00080000:2.0:1788361067.681843:0:3311:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8a89248000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361067.683217:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ab71b0a80 x1875232144069248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361067.683243:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144068992:0@lo:400:kworker.0 00000100:00100000:1.0:1788361067.683262:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144068864:0@lo:400:kworker.0 00000100:00100000:1.0:1788361067.683320:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144069248:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788361067.683372:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361067.683419:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144069248 00000100:00100000:1.0:1788361067.683425:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144069248 00000100:00100000:1.0:1788361067.683458:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788361067.683464:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144069248:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788361067.683478:0:14228:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1788361067.702393:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efc8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361067.702406:0:3313:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 418 00000100:00080000:3.0:1788361067.702417:0:3313:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8a9efc8000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361067.702464:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8986707100 x1875232144069376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361067.702495:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144069120:0@lo:400:kworker.0 00000100:00100000:0.0:1788361067.702566:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144069376:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788361067.702659:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361067.704051:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144069376 00000100:00100000:2.0:1788361067.704061:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144069376 00000100:00100000:2.0:1788361067.704130:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788361067.704139:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144069376:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1788361067.704156:0:14227:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788361067.704212:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144069376:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 73us (1552us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361067.704220:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788361067.706655:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efc8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361067.706665:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361067.706670:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144069376:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788361067.718451:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144069248:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 34980us (35073us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361067.718467:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788361067.718495:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a89248000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361067.718502:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361067.718506:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144069248:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:1.0:1788361067.743428:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a6c7f1e-7137-478a-bebd-d5781dcb5c03 00000001:00080000:1.0:1788361067.743451:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:1.0:1788361067.743456:0:5819:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fbf000/6a6c7f1e-7137-478a-bebd-d5781dcb5c03 00000001:00080000:1.0:1788361067.743479:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000020:00000080:3.0:1788361067.743546:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fbf000/6a6c7f1e-7137-478a-bebd-d5781dcb5c03 for lustre-MDT0000 00000020:00000080:3.0:1788361067.743606:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ab6fbf800 for lustre-MDT0000 00000001:00100000:1.0:1788361067.743938:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b731a8db-84ff-4db6-8c11-a2dda6e4d993 00000001:00080000:1.0:1788361067.743953:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:1.0:1788361067.743955:0:5819:0:(genops.c:906:class_export_put()) final put ffff9a8a83e48000/b731a8db-84ff-4db6-8c11-a2dda6e4d993 00000020:00000080:3.0:1788361067.744128:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83e48000/b731a8db-84ff-4db6-8c11-a2dda6e4d993 for lustre-MDT0000 00000020:00000080:3.0:1788361067.744165:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a83e4a800 for lustre-MDT0000 00000020:01000000:2.0:1788361068.000264:0:17267:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8abc7add80 - data ffff9a8a917851b0/ffff9a8a90b64000 00000020:01000000:2.0:1788361068.000388:0:17267:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a90953a20 - data ffff9a8ab53a5af8/ffff9a8a8836d400 00000001:00000004:2.0:1788361068.007595:0:17267:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00010000:00010000:0.0:1788361068.066685:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788361068.083005:0:17267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788361068.083014:0:17267:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788361068.083033:0:17267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361068.083036:0:17267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788361068.083734:0:14248:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788361068.083739:0:14248:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1788361068.083749:0:14248:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788361068.087775:0:17267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788361068.087786:0:17267:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 4 00000004:00080000:0.0:1788361068.087809:0:17267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361068.087812:0:17267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788361068.089553:0:14250:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788361068.089560:0:14250:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1788361068.089573:0:14250:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788361068.205152:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66112a2 00000020:00000080:0.0:1788361068.205173:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8aae463800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361068.205970:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66112b7 00000020:00000080:0.0:1788361068.205977:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8ab74b4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788361068.205983:0:17267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788361068.205989:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361068.205998:0:17267:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361068.206001:0:17267:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9a8a84f14d40) has no exports 00000004:01000000:0.0:1788361068.206173:0:17267:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788361068.206181:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611304 00000020:00000080:0.0:1788361068.206185:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8a8986a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788361068.206189:0:17267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788361068.206193:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361068.206197:0:17267:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788361068.206200:0:17267:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9a8a85713380) has no exports 00000020:00000080:0.0:1788361068.206206:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66112fd 00000020:00000080:0.0:1788361068.206209:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8a89868000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788361068.206682:0:17267:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788361068.206688:0:17267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788361068.206693:0:17267:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 5 00000004:00080000:0.0:1788361068.206699:0:17267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361068.206702:0:17267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361068.206743:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361068.206751:0:17267:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361068.206759:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66112ef 00000020:00000080:0.0:1788361068.206765:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8a83564000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788361068.206771:0:17267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788361068.206775:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361068.206779:0:17267:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788361068.206782:0:17267:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9a8ab7248000) has no exports 00000020:00000080:0.0:1788361068.206786:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66112e8 00000020:00000080:0.0:1788361068.206791:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8aae464000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788361068.207274:0:17267:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788361068.207287:0:17267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788361068.207290:0:17267:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1788361068.207294:0:17267:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361068.207296:0:17267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361068.207321:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361068.207326:0:17267:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361068.207348:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361068.207352:0:17267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361068.207380:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66112be 00000020:00000080:0.0:1788361068.207385:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8ab74b2800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788361068.207389:0:17267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788361068.207392:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361068.207396:0:17267:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361068.207398:0:17267:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9a8a84f10000) has no exports 00000020:00000080:0.0:1788361068.207412:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361068.207415:0:17267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788361068.207417:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66112c5 00000020:00000080:0.0:1788361068.207420:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8ab74b4000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788361068.207426:0:17267:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a89871ae800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788361068.207430:0:17267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a89871ae800 3 00000020:01000004:0.0:1788361068.207433:0:17267:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a89871ae800 from lustre-MDT0000 00000020:00000080:0.0:1788361068.207450:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361068.207452:0:17267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788361068.207455:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8aae466800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788361068.207457:0:17267:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae466800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788361068.207465:0:17267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:2.0:1788361068.207490:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae463800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788361068.207504:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab74b4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1788361068.207509:0:8:0:(genops.c:906:class_export_put()) final put ffff9a8aae464800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361068.207511:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae464800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788361068.207515:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:01000004:0.0:1788361068.207536:0:17267:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788361068.207540:0:17267:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788361068.207543:0:17267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788361068.207547:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361068.207549:0:17267:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788361068.207555:0:17267:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9a8a83376800 7b97d369-4bf1-43ee-a977-45b88f10e003 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361068.207561:0:17267:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9a898536b380) has exports, disconnecting them 00000020:00080000:0.0:1788361068.207572:0:17267:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a8a83376800), last request at 1788361006 00000020:00000080:0.0:1788361068.207587:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661126a 00000020:00010000:0.0:1788361068.207592:0:17267:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a83376800: total 7 00000100:00080000:0.0:1788361068.207595:0:17267:0:(import.c:65:import_set_state_nolock()) ffff9a8a83375800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788361068.207609:0:17267:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a83376800): rc 0 00000020:00080000:0.0:1788361068.207613:0:17267:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9a898536b380) has no exports 00000020:00000080:2.0:1788361068.207622:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8986a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788361068.207629:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a89868000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788361068.207636:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8abf244000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788361068.207642:0:8:0:(genops.c:906:class_export_put()) final put ffff9a8a83565000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361068.207644:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83565000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788361068.207649:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00010000:0.0:1788361068.207687:0:14214:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a83376800: total 4 00010000:00010000:0.0:1788361068.207692:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361068.207699:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83564000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788361068.207706:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae464000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788361068.207714:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8aae465800 for lustre-OST0000-osc-MDT0000 00010000:00010000:0.0:1788361068.207718:0:14214:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a83376800, canceled 0 locks, left on hash table 8. 00000020:00000080:2.0:1788361068.207719:0:8:0:(genops.c:906:class_export_put()) final put ffff9a8a83564800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361068.207723:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83564800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788361068.207728:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:00010000:0.0:1788361068.207749:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8b44800/0xf6a94c97d66113c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66113c1 expref: 9 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361068.207768:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6611684 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661167d expref: 8 pid: 14218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361068.207782:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8b45000/0xf6a94c97d6611278 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6611271 expref: 7 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788361068.207797:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab74b2800/lustre-MDD0000_UUID for lustre-MDD0000 00010000:00010000:0.0:1788361068.207797:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8c43400/0xf6a94c97d6611438 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6611431 expref: 6 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788361068.207803:0:8:0:(genops.c:906:class_export_put()) final put ffff9a8ab74b2000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788361068.207807:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab74b2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788361068.207813:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00010000:00010000:0.0:1788361068.207816:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611692 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661168b expref: 5 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361068.207834:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8b45400/0xf6a94c97d661139e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6611397 expref: 4 pid: 14220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361068.207846:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a898586a400/0xf6a94c97d6611390 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6611389 expref: 3 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361068.207865:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8aa8c42400/0xf6a94c97d661140e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6611407 expref: 2 pid: 14221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361068.207884:0:14214:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a83376800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1788361068.207940:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab74b4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788361068.208637:0:14214:0:(genops.c:906:class_export_put()) final put ffff9a8a83376800/7b97d369-4bf1-43ee-a977-45b88f10e003 00010000:00010000:0.0:1788361068.208651:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361068.208654:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361068.208656:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361068.208682:0:14221:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a8ac09ce200:14221] 2 exiting: rc = 0 00000100:00100000:0.0:1788361068.208768:0:14218:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a8a8358b800:14218] 0 exiting: rc = 1 00000020:00000080:0.0:1788361068.208801:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83376800/7b97d369-4bf1-43ee-a977-45b88f10e003 for MGS 00000020:00000080:0.0:1788361068.208825:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a83375800 for MGS 00000100:00100000:3.0:1788361068.209950:0:14220:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a8a8358b200:14220] 1 exiting: rc = 0 00000100:00100000:0.0:1788361068.210144:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210152:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210158:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210164:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210169:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210174:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210179:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210197:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210203:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210209:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210214:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210219:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210224:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210230:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210235:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210241:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210246:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210252:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210256:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210261:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210267:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210273:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210293:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210298:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210303:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210309:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210315:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210320:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210325:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210330:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210336:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210342:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210347:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210352:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210357:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210364:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210370:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210378:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210385:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210392:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210397:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210401:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210406:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210411:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210416:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210421:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210425:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210430:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210436:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210441:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210447:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210455:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210461:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210466:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210473:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210479:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210484:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210498:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210503:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210510:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210514:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210520:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210526:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.210534:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788361068.211011:0:17267:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788361068.211016:0:17267:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788361068.211545:0:17267:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a899fd780 - data ffff9a8aa9be6798/ffff9a8985a87800 00000020:01000000:0.0:1788361068.211661:0:17267:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8ab6cdd7e0 - data ffff9a8aa98346c0/ffff9a8ac1c71800 00000020:00000080:0.0:1788361068.212253:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661124e 00000020:00000080:0.0:1788361068.212261:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a89871ab000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788361068.212278:0:17267:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a89871ae800 from MGS, refs=2 00000020:01000004:0.0:1788361068.212282:0:17267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a89871ae800 2 00000020:01000004:0.0:1788361068.212286:0:17267:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a89871ae800 from MGS 00000020:00000080:0.0:1788361068.212313:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361068.212320:0:17267:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788361068.212323:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a89871af000/MGS 00000020:00000080:0.0:1788361068.212326:0:17267:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89871af000/MGS for MGS 00000020:01000000:0.0:1788361068.212334:0:17267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788361068.212386:0:17267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788361068.212391:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361068.212397:0:17267:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788361068.212403:0:17267:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a8a83563000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361068.212410:0:17267:0:(genops.c:1574:class_disconnect_exports()) OBD device 10 (ffff9a8a85714d40) has exports, disconnecting them 00000020:00080000:0.0:1788361068.212416:0:17267:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a8a83563000), last request at 1788361006 00000020:00000080:0.0:1788361068.212421:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661133c 00000020:00080000:0.0:1788361068.212434:0:17267:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a83563000): rc 0 00000020:00000080:0.0:1788361068.212438:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8a83563000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788361068.214392:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89871ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361068.214409:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83563000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788361068.217314:0:17267:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788361068.217325:0:17267:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361068.217329:0:17267:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788361068.217341:0:17267:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361068.217387:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a83cfa800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788361068.218650:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361068.218661:0:17267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788361068.218667:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8a8a119000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788361068.218671:0:17267:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a119000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788361068.218677:0:17267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788361068.218948:0:17267:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a89871ae800 1 00000020:00000080:3.0:1788361068.218955:0:17267:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611240 00000020:00000080:3.0:1788361068.218963:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a89871a9800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788361068.218978:0:17267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788361068.218989:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89871a9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361068.219003:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361068.219008:0:17267:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788361068.219012:0:17267:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9a8985368000) has no exports 00000001:00100000:2.0:1788361068.242647:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361068.242657:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c6c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361068.242866:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788361068.242927:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ac1c6e000 for lustre-OST0001 00000020:00000080:0.0:1788361068.257759:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361068.257774:0:17267:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788361068.257779:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a89871ab800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361068.257784:0:17267:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89871ab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788361068.257792:0:17267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788361068.257919:0:17267:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a89871ae000 00000020:01000000:0.0:1788361068.257941:0:17267:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788361068.257945:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361068.257949:0:17267:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788361068.257953:0:17267:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9a89853699c0) has no exports 00000100:00100000:0.0:1788361068.258025:0:14226:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a8a83d50200:14226] 0 exiting: rc = 1 00000100:00100000:3.0:1788361068.259134:0:16168:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a8984a11a00:16168] 3 exiting: rc = 0 00000100:00100000:1.0:1788361068.259150:0:14228:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a8a980f1800:14228] 2 exiting: rc = 0 00000100:00100000:2.0:1788361068.262618:0:14227:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a8ab7777a00:14227] 1 exiting: rc = 0 00000100:00100000:1.0:1788361068.266165:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266176:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266182:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266201:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266206:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266211:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266217:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266223:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266229:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266235:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266244:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266250:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266256:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266261:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266267:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266272:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266277:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266282:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266288:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266295:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266302:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266307:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266312:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266318:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266323:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266328:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266334:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266339:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266344:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266349:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266354:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266373:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266377:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266382:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266387:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266395:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266400:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266406:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266412:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266420:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266426:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266431:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266437:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266442:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266448:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266456:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266462:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266466:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266471:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266476:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266482:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266489:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266494:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266500:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266508:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266518:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266525:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266530:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266536:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266543:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266548:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266557:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266562:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.266568:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273375:0:14230:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a898586dc00:14230] 1 exiting: rc = 0 00000100:00100000:2.0:1788361068.273571:0:14229:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a898586c400:14229] 0 exiting: rc = 1 00000100:00100000:1.0:1788361068.273637:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273657:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273664:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273669:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273674:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273678:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273683:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273689:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273693:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273698:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273702:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273707:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273712:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273718:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273722:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273727:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273732:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273737:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273743:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273747:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273752:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273757:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273762:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273818:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273845:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273849:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273854:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273859:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273864:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273873:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273878:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273882:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273887:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273891:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273896:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273909:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273922:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273926:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273931:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273936:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273940:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273945:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273950:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273954:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273959:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273964:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273968:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273973:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273977:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273982:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273988:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273993:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.273997:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274001:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274006:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274010:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274015:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274019:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274023:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274033:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274037:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274041:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274046:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274051:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274455:0:14231:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a898586ca00:14231] 0 exiting: rc = 1 00000100:00100000:2.0:1788361068.274533:0:14232:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a8a85ddb200:14232] 1 exiting: rc = 0 00000100:00100000:1.0:1788361068.274637:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274646:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274653:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274660:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274667:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274674:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274690:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274696:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274702:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274720:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274728:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274734:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274740:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274746:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274751:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274756:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274762:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274768:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274774:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274779:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274786:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274806:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274813:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274818:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274826:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274831:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274836:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274841:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274847:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274853:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274857:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274862:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274868:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274886:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274893:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274911:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274917:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274922:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274927:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274933:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274939:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274951:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274956:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274961:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274967:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274985:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274992:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.274997:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275003:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275008:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275013:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275019:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275024:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275030:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275035:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275040:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275045:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275064:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275070:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275076:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275080:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275118:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275124:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.275136:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361068.282766:0:14233:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a8a85ddb600:14233] 0 exiting: rc = 1 00000100:00100000:0.0:1788361068.282880:0:14234:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a8a85ddbc00:14234] 1 exiting: rc = 0 00000100:00100000:1.0:1788361068.283054:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283061:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283065:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283070:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283076:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283081:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283231:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283237:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283243:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283248:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283253:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283259:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283277:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283282:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283286:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283291:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283295:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283300:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283305:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283310:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283315:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283319:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283324:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283329:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283334:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283339:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283344:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283349:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283354:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283359:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283363:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283368:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283373:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283379:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283384:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283390:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283395:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283401:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283406:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283412:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283417:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283422:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283427:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283433:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283437:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283443:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283447:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283459:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283463:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283469:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283474:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283478:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283484:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283490:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283496:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283500:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283504:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283509:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283514:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283518:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283523:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283527:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283531:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.283536:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.283851:0:14235:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a8ab76e9600:14235] 0 exiting: rc = 1 00000100:00100000:3.0:1788361068.283943:0:14236:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a8a85ddb800:14236] 1 exiting: rc = 0 00000100:00100000:1.0:1788361068.284033:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284039:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284045:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284050:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284055:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284060:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284065:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284070:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284076:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284082:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284121:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284127:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284132:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284136:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284142:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284147:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284152:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284157:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284170:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284176:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284181:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284186:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284191:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284196:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284202:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284206:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284211:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284216:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284222:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284226:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284231:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284236:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284241:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284247:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284252:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284258:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284263:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284267:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284272:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284277:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284282:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284287:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284292:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284297:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284303:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284308:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284313:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284318:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284324:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284329:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284334:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284339:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284344:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284357:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284362:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284367:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284373:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284378:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284383:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284388:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284394:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284399:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284403:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284409:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361068.284711:0:14238:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a8a85ea8200:14238] 1 exiting: rc = 0 00000100:00100000:3.0:1788361068.284817:0:14237:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a8a85702400:14237] 0 exiting: rc = 1 00000100:00100000:1.0:1788361068.284885:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284890:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284895:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284908:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284914:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284919:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284924:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284928:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284933:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284939:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284943:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284949:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284953:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284958:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284963:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284968:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284973:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284978:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284983:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284988:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284993:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.284997:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285002:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285006:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285019:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285024:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285029:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285034:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285038:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285042:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285047:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285051:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285056:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285061:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285067:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285071:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285076:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285081:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285179:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285185:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285189:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285194:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285199:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285204:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285209:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285214:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285219:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285223:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285229:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285234:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285238:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285244:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285249:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285254:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285260:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285266:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285271:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285276:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285281:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285294:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285298:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285303:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285308:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.285313:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361068.285855:0:14239:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a8ab6ca2000:14239] 0 exiting: rc = 1 00000100:00100000:1.0:1788361068.286407:0:14241:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a8a85646e00:14241] 2 exiting: rc = 0 00000100:00100000:0.0:1788361068.286691:0:14240:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a8a85de9e00:14240] 1 exiting: rc = 0 00000100:00100000:1.0:1788361068.286981:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.286989:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.286995:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287001:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287007:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287022:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287040:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287048:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287054:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287059:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287064:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287070:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287076:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287081:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287220:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287226:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287232:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287238:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287244:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287249:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287255:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287261:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287267:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287272:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287279:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287284:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287291:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287296:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287302:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287319:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287339:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287346:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287352:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287358:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287364:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287369:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287375:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287381:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287387:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287395:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287401:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287406:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287413:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287418:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287424:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287430:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287436:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287442:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287447:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287453:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287459:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287465:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287470:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287476:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287495:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287503:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287508:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287514:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287519:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287524:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287530:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287535:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287541:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361068.287546:0:17267:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788361068.292316:0:17267:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361068.292330:0:17267:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788361068.292336:0:17267:0:(genops.c:906:class_export_put()) final put ffff9a8a85598000/MDS_uuid 00000020:00000080:1.0:1788361068.292340:0:17267:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85598000/MDS_uuid for MDS 00000020:01000000:1.0:1788361068.292347:0:17267:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788361068.292472:0:17267:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788361069.089870:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788361069.251796:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361069.251805:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c6b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361069.251906:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788361069.252015:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ac1c6f000 for lustre-OST0000 00010000:00010000:3.0:1788361070.115371:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788361070.743453:0:17422:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788361070.750790:0:17422:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788361070.750843:0:17422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.750857:0:17422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.750863:0:17422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.750871:0:17422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.750904:0:17422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788361070.750909:0:17422:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788361070.750930:0:17422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361070.750935:0:17422:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788361070.750940:0:17422:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788361070.750946:0:17422:0:(import.c:65:import_set_state_nolock()) ffff9a8a89248000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788361070.750952:0:17422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361070.750953:0:17422:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788361070.750957:0:17422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788361070.751126:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361070.751134:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361070.751142:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a898586aa00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361070.751146:0:14214:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361070.751156:0:14214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361070.751164:0:14214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361070.751169:0:14214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361070.751171:0:14214:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788361070.751173:0:14214:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788361070.751211:0:14214:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361070.751217:0:14214:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361070.751241:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361070.751249:0:14214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586aa00/0xf6a94c97d66113c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66113c8 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361070.751278:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361070.751280:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361070.751281:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361070.751314:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144069504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361070.751419:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361070.751486:0:14211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144069504 00000100:00100000:3.0:1788361070.751493:0:14211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144069504 00000100:00100000:3.0:1788361070.751540:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361070.751547:0:14211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1875232144069504:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788361070.751552:0:14211:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788361070 with bad export cookie 17773821619414831722 00010000:00010000:2.0:1788361070.751806:0:17422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.751822:0:17422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.751829:0:17422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.751835:0:17422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.751851:0:17422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361070.751857:0:17422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.751864:0:17422:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.751870:0:17422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.751876:0:17422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361070.751899:0:17422:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788361070.751903:0:17422:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788361070.751919:0:17422:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788361070.751923:0:17422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788361070.751928:0:17422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361070.751933:0:17422:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788361070.751937:0:17422:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a8ab72499c0) has no exports 00000020:00080000:2.0:1788361070.751983:0:17422:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a8ab72499c0) has no exports 00000020:01000000:2.0:1788361070.754134:0:17422:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8abc7ad4e0 - data ffff9a8aa9a9a5e8/ffff9a8a8457d800 00000020:01000000:2.0:1788361070.754375:0:17422:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8985196e40 - data ffff9a8ab0746ca8/ffff9a8985085400 00010000:00010000:1.0:1788361070.754850:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361070.754859:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361070.754871:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705ae00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361070.754875:0:15712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361070.754897:0:15712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361070.754905:0:15712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361070.754910:0:15712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361070.754913:0:15712:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788361070.754916:0:15712:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788361070.754962:0:15712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361070.754969:0:15712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361070.754992:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361070.754999:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab705ae00/0xf6a94c97d6611397 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661139e expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361070.755030:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361070.755033:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361070.755038:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8a00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361070.755040:0:15712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361070.755047:0:15712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361070.755052:0:15712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361070.755058:0:15712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788361070.755060:0:15712:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788361070.755062:0:15712:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788361070.755076:0:15712:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361070.755081:0:15712:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361070.755107:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361070.755114:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8a00/0xf6a94c97d661168b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611692 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361070.755123:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361070.755125:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361070.755133:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361070.755160:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144069632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361070.755224:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361070.755260:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361070.755266:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144069760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361070.755286:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361070.755325:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144069632 00000100:00100000:1.0:1788361070.755333:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144069632 00000100:00100000:1.0:1788361070.755360:0:14212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144069760 00000100:00100000:1.0:1788361070.755363:0:14212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144069760 00000100:00100000:1.0:1788361070.755375:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788361070.755383:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1875232144069632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788361070.755389:0:14212:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788361070 with bad export cookie 17773821619414831722 00000100:00100000:1.0:1788361070.755435:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1875232144069632:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (211us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788361070.755443:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788361070.755459:0:14212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361070.755463:0:14212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1875232144069760:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788361070.755467:0:14212:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788361070 with bad export cookie 17773821619414831722 00000100:00100000:1.0:1788361070.755491:0:14212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3311:x1875232144069760:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (204us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788361070.755496:0:14212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788361070.755530:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788361070.755535:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9a89871ad000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788361070.755539:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788361070.769791:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.160@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788361070.769797:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788361070.769828:0:3311:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8986706a00 x1875232144069504/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361086 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361070.769849:0:3311:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ab71b2300 x1875232144069632/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361086 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361070.769857:0:3311:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ab71b0380 x1875232144069760/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361086 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788361070.769866:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788361070.769869:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788361070.769870:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788361070.769874:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9a89871ad000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361070.769880:0:3311:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 396 00000100:00100000:0.0:1788361070.770019:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7b97d369-4bf1-43ee-a977-45b88f10e003:3314:1875232144069504:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788361070.770055:0:3311:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a89871ad000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361070.770327:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ab71b0e00 x1875232144069888/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361070.770374:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b97d369-4bf1-43ee-a977-45b88f10e003:3310:1875232144069888:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788361070.770429:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875232144069888 offset 0 length 520: 4 00000100:00100000:1.0:1788361070.770436:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144069632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361070.770449:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7b97d369-4bf1-43ee-a977-45b88f10e003:3311:1875232144069760:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361070.771239:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1788361070.782008:0:14211:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875232144069504 offset 224 length 224: 4 00000100:00100000:3.0:1788361070.782035:0:14211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3314:x1875232144069504:12345-0@lo:103:ldlm_bl.0 Request processed in 30486us (30614us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361070.782047:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00100000:10000000:2.0:1788361070.788136:0:17422:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788361070.827452:0:17422:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66113ac 00000020:00000080:2.0:1788361070.827462:0:17422:0:(genops.c:906:class_export_put()) final put ffff9a8ab76df800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788361070.827488:0:17422:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a9efc3000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788361070.827491:0:17422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a9efc3000 2 00000020:01000004:2.0:1788361070.827494:0:17422:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8a9efc3000 from lustre-OST0000 00000020:00000080:2.0:1788361070.827521:0:17422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361070.827531:0:17422:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788361070.827533:0:17422:0:(genops.c:906:class_export_put()) final put ffff9a8ab76dd800/lustre-OST0000_UUID 00000020:00000080:2.0:1788361070.827536:0:17422:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76dd800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788361070.827542:0:17422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788361070.827590:0:17422:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788361070.827595:0:17422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788361070.827600:0:17422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361070.827605:0:17422:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788361070.827611:0:17422:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a8ab76d8800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361070.827617:0:17422:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9a8ab724cd40) has exports, disconnecting them 00000020:00080000:2.0:1788361070.827622:0:17422:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a8ab76d8800), last request at 1788361017 00000020:00000080:2.0:1788361070.827626:0:17422:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66113d6 00000020:00080000:2.0:1788361070.827638:0:17422:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8ab76d8800): rc 0 00000020:00000080:2.0:1788361070.827643:0:17422:0:(genops.c:906:class_export_put()) final put ffff9a8ab76d8800/lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788361070.828371:0:17422:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788361070.828376:0:17422:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361070.828381:0:17422:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788361070.828387:0:17422:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788361070.828588:0:17422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361070.828595:0:17422:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788361070.828600:0:17422:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a9efc3000 1 00000020:00000080:2.0:1788361070.828605:0:17422:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661137b 00000020:00000080:2.0:1788361070.828609:0:17422:0:(genops.c:906:class_export_put()) final put ffff9a8a85dab000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788361070.828613:0:17422:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788361070.828616:0:17422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361070.828619:0:17422:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788361070.828622:0:17422:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a8a90bf4d40) has no exports 00000020:00000080:0.0:1788361070.828833:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76df800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788361070.828847:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76d8800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788361070.828852:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a89248000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788361070.828857:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a8ab76dd000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788361070.828859:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76dd000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788361070.828863:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788361070.828924:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85dab000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788361070.856556:0:17422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361070.856572:0:17422:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788361070.856578:0:17422:0:(genops.c:906:class_export_put()) final put ffff9a8a9efc5000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788361070.856582:0:17422:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efc5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788361070.856589:0:17422:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788361070.856776:0:17422:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8a9efc0000 00000020:02000400:1.0:1788361070.856823:0:17422:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788361071.139714:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361072.166307:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361072.800213:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7b97d369-4bf1-43ee-a977-45b88f10e003->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361072.800224:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7b97d369-4bf1-43ee-a977-45b88f10e003->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788361072.800228:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361072.800231:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361072.800236:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efc8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361072.800246:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 457 00000100:00080000:3.0:1788361072.800252:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361072.800262:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8a9efc8000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361072.801022:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8986706d80 x1875232144070016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361072.801203:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144070016:0@lo:38:kworker.0 00000400:00000100:0.0:1788361072.801259:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144070016 offset 0 length 520: 4 00000020:01000004:0.0:1788361072.982446:0:17572:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788361072.994693:0:17572:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788361072.994790:0:17572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.994807:0:17572:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.994814:0:17572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.994822:0:17572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.994846:0:17572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788361072.994851:0:17572:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788361072.994887:0:17572:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361072.994901:0:17572:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8986706d80 x1875232144070016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788361087 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361072.994928:0:17572:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788361072.994935:0:17572:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788361072.994943:0:17572:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efc8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788361072.994948:0:17572:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361072.994953:0:17572:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8986706d80 x1875232144070016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788361087 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361072.994974:0:17572:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788361072.994978:0:17572:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:1.0:1788361072.995053:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144070016:0@lo:38:kworker.0 00010000:00010000:2.0:1788361072.995308:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361072.995317:0:14215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361072.995327:0:14215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361072.995331:0:14215:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361072.995341:0:14215:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361072.995349:0:14215:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361072.995355:0:14215:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361072.995357:0:14215:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788361072.995360:0:14215:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788361072.995374:0:14215:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a89871ad000 00010000:00010000:2.0:1788361072.995378:0:14215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361072.995385:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8aa8b44200/0xf6a94c97d6611431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6611438 expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361072.995407:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361072.995409:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361072.995411:0:14215:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361072.997027:0:17572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.997044:0:17572:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.997052:0:17572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.997058:0:17572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361072.997261:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361072.997268:0:14214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361072.997275:0:14214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab705b800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361072.997280:0:14214:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361072.997297:0:14214:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361072.997304:0:14214:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361072.997310:0:14214:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361072.997312:0:14214:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788361072.997322:0:14214:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a89871ad000 00010000:00010000:3.0:1788361072.997326:0:14214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361072.997334:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361072.997336:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361072.997338:0:14214:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361072.997527:0:17572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361072.997533:0:17572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab705b800/0xf6a94c97d6611407 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d661140e expref: -99 pid: 15528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.997550:0:17572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.997557:0:17572:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.997563:0:17572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.997568:0:17572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361072.997658:0:17572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788361072.997663:0:17572:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788361072.997668:0:17572:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788361072.997695:0:17572:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788361072.997700:0:17572:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788361072.997704:0:17572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361072.997711:0:17572:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788361072.997716:0:17572:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a8ab77a4d40) has no exports 00000020:00080000:0.0:1788361072.997744:0:17572:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a8ab77a4d40) has no exports 00010000:00010000:1.0:1788361073.003519:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361073.003532:0:15712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361073.003564:0:15712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361073.003568:0:15712:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361073.003578:0:15712:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361073.003586:0:15712:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361073.003592:0:15712:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788361073.003594:0:15712:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788361073.003597:0:15712:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788361073.003612:0:15712:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a89871ad000 00010000:00010000:1.0:1788361073.003616:0:15712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361073.003623:0:15712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d661167d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6611684 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361073.003639:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361073.003640:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361073.003642:0:15712:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788361073.003689:0:17572:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8ac0d0bc00 - data ffff9a8a917f9d80/ffff9a898714f000 00000020:01000000:0.0:1788361073.003834:0:17572:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8985196cc0 - data ffff9a8ab07615e8/ffff9a8985087400 00100000:10000000:0.0:1788361073.016632:0:17572:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788361073.045911:0:17572:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661141c 00000020:00000080:2.0:1788361073.045921:0:17572:0:(genops.c:906:class_export_put()) final put ffff9a8ab76df000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788361073.045942:0:17572:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a8a10b000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788361073.045948:0:17572:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a8a10b000 2 00000020:01000004:2.0:1788361073.045951:0:17572:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8a8a10b000 from lustre-OST0001 00000020:00000080:2.0:1788361073.045974:0:17572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361073.045984:0:17572:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788361073.045987:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76df000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788361073.045988:0:17572:0:(genops.c:906:class_export_put()) final put ffff9a8ab76da800/lustre-OST0001_UUID 00000020:00000080:2.0:1788361073.045992:0:17572:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76da800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788361073.046003:0:17572:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788361073.046121:0:17572:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7b97d369-4bf1-43ee-a977-45b88f10e003->MGS 00010000:00010000:2.0:1788361073.046135:0:17572:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a898586ac00/0xf6a94c97d6611389 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6611390 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361073.046147:0:17572:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a898586ac00/0xf6a94c97d6611389 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6611390 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361073.046153:0:17572:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788361073.046155:0:17572:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788361073.046158:0:17572:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788361073.046170:0:17572:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a89871ad000 00010000:00010000:2.0:1788361073.046174:0:17572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a898586ac00/0xf6a94c97d6611389 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6611390 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361073.046186:0:17572:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361073.046206:0:17572:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361073.046212:0:17572:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361073.046219:0:17572:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788361073.046221:0:17572:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788361073.046233:0:17572:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a89871ad000 00010000:00010000:2.0:1788361073.046236:0:17572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8aa8c43c00/0xf6a94c97d6611271 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6611278 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361073.046255:0:17572:0:(import.c:65:import_set_state_nolock()) ffff9a89871ad000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788361073.046259:0:17572:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788361073.046262:0:17572:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788361073.046264:0:17572:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788361073.046267:0:17572:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788361073.046277:0:17572:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ab71b0e00 x1875232144069888/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788361080 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788361073.046288:0:17572:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788361073.046290:0:17572:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1788361073.046346:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7b97d369-4bf1-43ee-a977-45b88f10e003:3310:1875232144069888:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:2.0:1788361073.046713:0:17572:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788361073.046721:0:17572:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661125c 00000020:00000080:2.0:1788361073.046726:0:17572:0:(genops.c:906:class_export_put()) final put ffff9a89871a9000/7b97d369-4bf1-43ee-a977-45b88f10e003 00000020:01000000:2.0:1788361073.046793:0:17572:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.160@tcp (flags='') 00000020:00000080:2.0:1788361073.046799:0:17572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361073.046804:0:17572:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.160@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788361073.046808:0:17572:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9a898536cd40) has no exports 00000020:00000080:0.0:1788361073.046809:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89871a9000/7b97d369-4bf1-43ee-a977-45b88f10e003 for MGC192.168.203.160@tcp 10000000:01000000:1.0:1788361073.046856:0:14223:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788361073.046964:0:17572:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.160@tcp: client import never connected 00000100:00080000:2.0:1788361073.046968:0:17572:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788361073.046970:0:17572:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788361073.046973:0:17572:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788361073.046982:0:17572:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788361073.047031:0:17572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361073.047036:0:17572:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.160@tcp (uuid 7b97d369-4bf1-43ee-a977-45b88f10e003) 00000020:01000000:2.0:1788361073.047041:0:17572:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788361073.047044:0:17572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361073.047048:0:17572:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00000080:0.0:1788361073.047050:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89871ad000 for MGC192.168.203.160@tcp 00000020:00080000:2.0:1788361073.047055:0:17572:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a8a85da8800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:0.0:1788361073.047059:0:8:0:(genops.c:906:class_export_put()) final put ffff9a8a8559b000/7b97d369-4bf1-43ee-a977-45b88f10e003 00000020:00080000:2.0:1788361073.047063:0:17572:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9a8984a58000) has exports, disconnecting them 00000020:00000080:0.0:1788361073.047064:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8559b000/7b97d369-4bf1-43ee-a977-45b88f10e003 for MGC192.168.203.160@tcp 00000020:00080000:2.0:1788361073.047071:0:17572:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a8a85da8800), last request at 1788361028 00000020:01000000:0.0:1788361073.047071:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.160@tcp (7b97d369-4bf1-43ee-a977-45b88f10e003) 00000020:00000080:2.0:1788361073.047079:0:17572:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611446 00000020:00080000:2.0:1788361073.047117:0:17572:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a85da8800): rc 0 00000020:00000080:2.0:1788361073.047122:0:17572:0:(genops.c:906:class_export_put()) final put ffff9a8a85da8800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788361073.047491:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85da8800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788361073.050220:0:17572:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788361073.050230:0:17572:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361073.050235:0:17572:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788361073.050242:0:17572:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361073.050277:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a9efc8000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788361073.057240:0:14215:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788361073.057582:0:14214:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788361073.057910:0:15712:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788361073.058059:0:14210:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a8a90bd0200:14210] 1 exiting: rc = 0 00000100:00100000:3.0:1788361073.058323:0:14209:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a8a8a130400:14209] 0 exiting: rc = 1 00000100:00100000:1.0:1788361073.058509:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361073.058796:0:14212:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a8ac09cf000:14212] 1 exiting: rc = 0 00000100:00100000:0.0:1788361073.058853:0:16251:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a8985353400:16251] 3 exiting: rc = 0 00000100:00100000:1.0:1788361073.058945:0:14213:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a8ac09cec00:14213] 2 exiting: rc = 0 00000100:00100000:3.0:1788361073.060378:0:14211:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a8a90bd1000:14211] 0 exiting: rc = 1 00000100:00100000:1.0:1788361073.060627:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060647:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060652:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060658:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060665:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060669:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060674:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060679:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060684:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060689:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060694:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060699:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060704:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060709:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060714:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060720:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060725:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060730:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060738:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060743:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060748:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060753:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060758:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060764:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060769:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060774:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060779:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060784:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060789:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060795:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060800:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060805:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060811:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060816:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060821:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060826:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060838:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060843:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060849:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060854:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060859:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060874:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060880:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060885:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060889:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060894:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060899:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060904:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060910:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060915:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060921:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060926:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060931:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060936:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060940:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060945:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060950:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060955:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060962:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060967:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060972:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060977:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060982:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.060988:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788361073.061741:0:17572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361073.061751:0:17572:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788361073.061757:0:17572:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fbe800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788361073.061761:0:17572:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fbe800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788361073.061770:0:17572:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788361073.061813:0:17572:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a8a10b000 1 00000020:00000080:1.0:1788361073.061825:0:17572:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611400 00000020:00000080:1.0:1788361073.061831:0:17572:0:(genops.c:906:class_export_put()) final put ffff9a8a9efcb000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788361073.061889:0:17572:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788361073.061894:0:17572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361073.061899:0:17572:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361073.061903:0:17572:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a8a85710000) has no exports 00000020:00000080:0.0:1788361073.062112:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efcb000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788361073.072350:0:17572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361073.072364:0:17572:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788361073.072369:0:17572:0:(genops.c:906:class_export_put()) final put ffff9a8a8a10f000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788361073.072373:0:17572:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a10f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788361073.072379:0:17572:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788361073.072562:0:17572:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8a8a109800 00000020:01000000:1.0:1788361073.072582:0:17572:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788361073.072586:0:17572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361073.072590:0:17572:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788361073.072594:0:17572:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9a8ab724b380) has no exports 00000020:00000080:1.0:1788361073.072620:0:17572:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361073.072626:0:17572:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788361073.072629:0:17572:0:(genops.c:906:class_export_put()) final put ffff9a8a85da8000/OSS_uuid 00000020:00000080:1.0:1788361073.072632:0:17572:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85da8000/OSS_uuid for OSS 00000020:01000000:1.0:1788361073.072637:0:17572:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788361073.073425:0:14862:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a8987c0ba00:14862] 0 exiting: rc = 1 00000100:00080000:3.0:1788361073.074260:0:14222:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788361073.074386:0:14865:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a8984b8d000:14865] 2 exiting: rc = 0 00000100:00100000:3.0:1788361073.074425:0:15711:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a8985035600:15711] 3 exiting: rc = 0 00000100:00100000:3.0:1788361073.074493:0:14864:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a8a8563f800:14864] 1 exiting: rc = 0 00000100:00100000:1.0:1788361073.074603:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074613:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074619:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074623:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074627:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074632:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074636:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074655:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074661:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074666:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074670:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074675:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074686:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074691:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074695:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074701:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074706:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074711:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074717:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074722:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074727:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074733:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074739:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074745:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074750:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074755:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074760:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074765:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074770:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074775:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074780:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074785:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074790:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074795:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074801:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074807:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074811:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074815:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074821:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074825:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074830:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074835:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074840:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074845:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074850:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074855:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074860:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074885:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074890:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074895:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074901:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074906:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074911:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074916:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074921:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074926:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074932:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074943:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074951:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074955:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074959:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074964:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074969:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.074974:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361073.076656:0:14867:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a8a90b84a00:14867] 1 exiting: rc = 0 00000100:00100000:2.0:1788361073.076685:0:14866:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a8a8120a200:14866] 0 exiting: rc = 1 00000100:00100000:1.0:1788361073.077159:0:16006:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9a89870aa600:16006] 2 exiting: rc = 0 00000100:00100000:1.0:1788361073.077230:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077238:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077243:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077248:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077254:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077259:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077264:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077269:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077274:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077279:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077285:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077289:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077295:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077301:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077305:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077311:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077317:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077334:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077338:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077343:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077349:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077354:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077359:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077364:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077369:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077374:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077380:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077385:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077390:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077395:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077400:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077404:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077409:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077414:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077419:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077424:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077429:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077435:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077439:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077444:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077449:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077454:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077461:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077469:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077476:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077481:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077487:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077492:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077498:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077503:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077511:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077517:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077528:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077534:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077539:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077545:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077550:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077555:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077560:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077565:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077570:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077574:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077579:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.077584:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361073.078577:0:14870:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a8a84f33400:14870] 2 exiting: rc = 0 00000100:00100000:0.0:1788361073.078721:0:16365:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9a8a866c3e00:16365] 3 exiting: rc = 0 00000100:00100000:0.0:1788361073.078863:0:16366:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff9a8a90a13000:16366] 4 exiting: rc = 0 00000100:00100000:3.0:1788361073.080444:0:14868:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a8a90b85600:14868] 0 exiting: rc = 1 00000100:00100000:2.0:1788361073.081265:0:14869:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a8a90b85200:14869] 1 exiting: rc = 0 00000100:00100000:1.0:1788361073.081427:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081435:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081441:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081447:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081452:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081457:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081462:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081468:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081473:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081479:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081484:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081490:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081496:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081501:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081507:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081527:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081533:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081538:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081544:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081548:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081553:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081558:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081564:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081581:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081588:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081596:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081601:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081607:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081613:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081618:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081623:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081629:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081634:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081639:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081645:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081649:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081654:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081660:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081665:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081684:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081690:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081696:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081701:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081707:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081712:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081717:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081723:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081729:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081734:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081739:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081745:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081750:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081755:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081761:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081767:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081772:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081778:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081783:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081796:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081801:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081807:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081813:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081818:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.081831:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361073.085932:0:14871:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a8a84f32400:14871] 0 exiting: rc = 1 00000100:00100000:3.0:1788361073.086024:0:14872:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a8a84f32000:14872] 1 exiting: rc = 0 00000100:00100000:1.0:1788361073.086306:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086315:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086319:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086324:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086332:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086336:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086340:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086345:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086349:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086353:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086358:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086362:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086367:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086371:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086376:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086380:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086384:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086389:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086393:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086398:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086405:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086409:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086415:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086420:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086425:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086430:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086434:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086439:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086444:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086462:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086467:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086471:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086476:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086481:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086485:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086490:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086495:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086500:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086505:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086510:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086516:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086521:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086525:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086530:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086538:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086544:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086549:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086554:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086559:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086565:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086570:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086574:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086579:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086585:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086589:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086595:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086601:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086606:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086611:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086616:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086621:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086626:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086630:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.086642:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361073.088876:0:14873:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a898509d400:14873] 0 exiting: rc = 1 00000100:00100000:2.0:1788361073.088966:0:14874:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a898509c600:14874] 1 exiting: rc = 0 00000100:00100000:1.0:1788361073.089103:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089112:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089119:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089144:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089151:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089157:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089162:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089168:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089173:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089179:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089185:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089191:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089197:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089204:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089210:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089230:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089237:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089243:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089249:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089255:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089261:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089266:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089272:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089277:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089283:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089288:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089294:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089312:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089318:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089324:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089329:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089335:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089340:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089345:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089350:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089368:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089374:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089379:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089386:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089405:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089412:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089417:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089422:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089428:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089434:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089439:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089445:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089450:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089455:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089462:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089467:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089486:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089493:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089499:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089505:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089511:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089516:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089522:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089527:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089533:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089538:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089543:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089548:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361073.089554:0:17572:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788361073.099367:0:17572:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788361086.016124:0:18187:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788361092.080788:0:18601:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788361092.080792:0:18601:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788361092.080925:0:18601:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8ab6fbc800 00000020:01000004:2.0:1788361092.080940:0:18601:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788361092.080948:0:18601:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788361092.080959:0:18601:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a8ab77a4d40) 00000020:00000080:2.0:1788361092.080972:0:18601:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788361092.097997:0:18601:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788361092.099868:0:18601:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1788361092.100256:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1788361092.100358:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:2.0:1788361092.100455:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:2.0:1788361092.100558:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1788361092.100659:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1788361092.102896:0:18601:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788361092.102988:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:2.0:1788361092.103500:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:2.0:1788361092.104982:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 660: rc = 0 00100000:10000000:2.0:1788361092.106065:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 660: rc = 0 00100000:10000000:2.0:1788361092.106693:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 790: rc = 0 00100000:10000000:2.0:1788361092.107516:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361092.107811:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 790: rc = 0 00100000:10000000:2.0:1788361092.108057:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361092.108556:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361092.108883:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 790: rc = 0 00100000:10000000:2.0:1788361092.109238:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 790: rc = 0 00100000:10000000:2.0:1788361092.109547:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361092.109797:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361092.110295:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 790: rc = 0 00100000:10000000:2.0:1788361092.110560:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361092.110815:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 790: rc = 0 00100000:10000000:2.0:1788361092.111527:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 311: rc = 0 00100000:10000000:2.0:1788361092.111784:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 311: rc = 0 00100000:10000000:2.0:1788361092.112020:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 311: rc = 0 00100000:10000000:2.0:1788361092.112805:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 311: rc = 0 00100000:10000000:2.0:1788361092.113052:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 311: rc = 0 00100000:10000000:2.0:1788361092.113576:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 311: rc = 0 00100000:10000000:2.0:1788361092.113819:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 311: rc = 0 00100000:10000000:2.0:1788361092.114066:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 311: rc = 0 00100000:10000000:2.0:1788361092.114454:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 311: rc = 0 00100000:10000000:2.0:1788361092.114705:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 311: rc = 0 00100000:10000000:2.0:1788361092.114957:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 311: rc = 0 00100000:10000000:2.0:1788361092.115516:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 311: rc = 0 00100000:10000000:2.0:1788361092.115765:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 311: rc = 0 00100000:10000000:2.0:1788361092.116018:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 311: rc = 0 00100000:10000000:2.0:1788361092.116451:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 311: rc = 0 00100000:10000000:2.0:1788361092.116693:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 311: rc = 0 00100000:10000000:2.0:1788361092.116944:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 311: rc = 0 00100000:10000000:2.0:1788361092.117543:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 311: rc = 0 00100000:10000000:2.0:1788361092.118471:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 311: rc = 0 00100000:10000000:2.0:1788361092.118712:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 311: rc = 0 00100000:10000000:2.0:1788361092.118967:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 311: rc = 0 00100000:10000000:2.0:1788361092.121567:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 311: rc = 0 00100000:10000000:2.0:1788361092.121859:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 311: rc = 0 00100000:10000000:2.0:1788361092.122459:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 311: rc = 0 00100000:10000000:2.0:1788361092.122712:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 311: rc = 0 00100000:10000000:2.0:1788361092.122977:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 311: rc = 0 00100000:10000000:2.0:1788361092.123531:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 311: rc = 0 00100000:10000000:2.0:1788361092.123784:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 311: rc = 0 00100000:10000000:2.0:1788361092.124402:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 311: rc = 0 00100000:10000000:2.0:1788361092.124657:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 311: rc = 0 00100000:10000000:2.0:1788361092.125349:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 311: rc = 0 00100000:10000000:2.0:1788361092.125585:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 311: rc = 0 00100000:10000000:2.0:1788361092.125930:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 392: rc = 0 00100000:10000000:2.0:1788361092.126916:0:18601:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788361092.127407:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 664: rc = 0 00100000:10000000:2.0:1788361092.127594:0:18601:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788361092.127666:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 664: rc = 0 00100000:10000000:2.0:1788361092.127941:0:18601:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788361092.128071:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 664: rc = 0 00100000:10000000:2.0:1788361092.128705:0:18601:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788361092.128788:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 661: rc = 0 00100000:10000000:2.0:1788361092.128957:0:18601:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788361092.129361:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 661: rc = 0 00100000:10000000:2.0:1788361092.129524:0:18601:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788361092.129565:0:18601:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 661: rc = 0 00000020:00000080:2.0:1788361092.129801:0:18601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788361092.129808:0:18601:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788361092.129817:0:18601:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d6611939 00000020:01000004:2.0:1788361092.129825:0:18601:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788361092.129829:0:18601:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788361092.129834:0:18601:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8ab6fbc800 from MGS 00000020:01000004:2.0:1788361092.129837:0:18601:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788361092.129845:0:18601:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a8ab77a0000) 00000020:00000080:2.0:1788361092.129854:0:18601:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788361092.129905:0:18601:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8ab6fbc800 from MGS, refs=2 00080000:01000000:2.0:1788361092.129910:0:18601:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788361092.129915:0:18601:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d6611947 00000100:00100000:2.0:1788361092.130079:0:18601:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788361092.130417:0:18601:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788361092.130423:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788361092.130874:0:18601:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788361092.130881:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788361092.131627:0:18601:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361092.131773:0:18601:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788361092.131779:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788361092.132500:0:18601:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788361092.132507:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788361092.132733:0:18601:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788361092.132750:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788361092.133408:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361092.133411:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361092.133413:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361092.133559:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361092.133561:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361092.133563:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361092.133948:0:18601:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788361092.135413:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788361092.145421:0:18601:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788361092.145438:0:18601:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788361092.145441:0:18601:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788361092.147785:0:18610:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788361092.147944:0:18601:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788361092.148049:0:18601:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361092.149673:0:18601:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788361092.149963:0:18601:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361092.150136:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788361092.150147:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788361092.154766:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788361092.154781:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788361092.155330:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788361092.155338:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788361092.155957:0:18601:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788361092.155974:0:18601:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.160@tcp' 00000020:01000004:3.0:1788361092.155976:0:18601:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788361092.156011:0:18601:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.160@tcp (typ=mgc) 00000020:00000080:3.0:1788361092.156023:0:18601:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.160@tcp (ffff9a8984a5b380) 00000020:00000080:3.0:1788361092.156036:0:18601:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788361092.156123:0:18601:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8ac0588000@MGC192.168.203.160@tcp: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361092.156408:0:18601:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.160@tcp-0 is initialized 00000040:01000000:3.0:1788361092.156414:0:18601:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788361092.156775:0:18616:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788361092.156824:0:18601:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.160@tcp (uuid 2cb705f4-a3cf-4d33-acc9-f3301f47b64a) 00000020:00000080:1.0:1788361092.156838:0:18601:0:(genops.c:1406:class_connect()) connect: client 2cb705f4-a3cf-4d33-acc9-f3301f47b64a, cookie 0xf6a94c97d6611955 00000100:00080000:1.0:1788361092.156846:0:18601:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361092.156851:0:18601:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a8ac0588000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361092.156878:0:18601:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ab71b0000 x1875232144070144/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361092.156896:0:18601:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2cb705f4-a3cf-4d33-acc9-f3301f47b64a->MGS 00000020:01000004:1.0:1788361092.156910:0:18601:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788361092.156914:0:18601:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788361092.156921:0:18601:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a8a85710000) 00000020:00000080:1.0:1788361092.156929:0:18601:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:0.0:1788361092.157125:0:18615:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1788361092.169715:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3310:1875232144070144:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788361092.169806:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361092.173259:0:18601:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361092.173868:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788361092.173875:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788361092.174016:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144070144 00000100:00100000:1.0:1788361092.174026:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144070144 00000100:00100000:1.0:1788361092.174067:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361092.174075:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3310:x1875232144070144:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788361092.174132:0:18613:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 2cb705f4-a3cf-4d33-acc9-f3301f47b64a@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:1.0:1788361092.174165:0:18613:0:(genops.c:1406:class_connect()) connect: client 2cb705f4-a3cf-4d33-acc9-f3301f47b64a, cookie 0xf6a94c97d6611963 00000100:00080000:1.0:1788361092.174271:0:18613:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a10b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361092.174351:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+5:3310:x1875232144070144:12345-0@lo:250:mount.lustre.0 Request processed in 276us (4545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361092.174359:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361092.174830:0:3310:0:(client.c:3115:ptlrpc_free_committed()) MGC192.168.203.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788361092.174840:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.160@tcp: connect to target with instance 0 00000100:00080000:1.0:1788361092.174847:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788361092.174852:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788361092.174862:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac0588000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788361092.174864:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788361092.174873:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788361092.174878:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3310:1875232144070144:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788361092.179506:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788361092.179517:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788361092.180071:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788361092.180079:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788361092.180861:0:18601:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361092.181304:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788361092.181310:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788361092.181805:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788361092.181812:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788361092.228864:0:18601:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361092.229573:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788361092.229581:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788361092.231323:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788361092.231334:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788361092.232339:0:18601:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361092.232809:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788361092.232815:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788361092.233536:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788361092.233543:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788361092.236343:0:18601:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361092.236802:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788361092.236809:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788361092.237595:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788361092.237603:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788361092.238527:0:18601:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361092.238802:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788361092.238809:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788361092.239478:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788361092.239485:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788361092.266082:0:18601:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361092.266397:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788361092.266404:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788361092.268032:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788361092.268044:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788361092.269067:0:18601:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788361092.269124:0:18601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788361092.271339:0:18601:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788361092.271368:0:18601:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788361092.271374:0:18601:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788361092.271513:0:18601:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788361092.271552:0:18601:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788361092.271557:0:18601:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788361092.271558:0:18601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361092.271560:0:18601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361092.271561:0:18601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361092.271563:0:18601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361092.271564:0:18601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361092.271565:0:18601:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361092.271566:0:18601:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361092.271568:0:18601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361092.271570:0:18601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361092.271573:0:18601:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788361092.271575:0:18601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361092.271576:0:18601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361092.271577:0:18601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361092.271578:0:18601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361092.271579:0:18601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361092.271580:0:18601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361092.271581:0:18601:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361092.271582:0:18601:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361092.271588:0:18601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361092.271589:0:18601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361092.271615:0:18601:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788361092.271634:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070272:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361092.271710:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.271774:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361092.271986:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144070272 00000100:00100000:1.0:1788361092.271994:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144070272 00000100:00100000:1.0:1788361092.272039:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361092.272047:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+5:18601:x1875232144070272:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788361092.272112:0:18614:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361092.272115:0:18614:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788361092.272118:0:18614:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788361092.272429:0:18635:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788361092.272773:0:18614:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:3.0:1788361092.274282:0:18636:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788361092.274291:0:18636:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788361092.274301:0:18636:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788361092.274340:0:18636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788361092.275366:0:18614:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361092.275385:0:18614:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788361092.283053:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+5:18601:x1875232144070272:12345-0@lo:253:mount.lustre.0 Request processed in 10996us (11332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361092.283069:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361092.283557:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070272:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361092.283573:0:18601:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788361092.283576:0:18601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361092.283578:0:18601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361092.283592:0:18601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361092.283593:0:18601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361092.283595:0:18601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361092.283596:0:18601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361092.283598:0:18601:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361092.283599:0:18601:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361092.283601:0:18601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361092.283602:0:18601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788361092.283621:0:18601:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8ab6fbc800 from lustre-MDT0000 10000000:01000000:0.0:1788361092.283645:0:18601:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788361092.283648:0:18601:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788361092.283653:0:18601:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a8984a5b380 10000000:01000000:0.0:1788361092.283656:0:18601:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361092.283897:0:18601:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a8984a5b380 from 1 10000000:01000000:0.0:1788361092.283901:0:18601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788361092.283939:0:18601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.283950:0:18601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.283960:0:18601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361092.283979:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361092.284209:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.284241:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361092.285803:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144070400 00000100:00100000:1.0:1788361092.285815:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144070400 00000100:00100000:1.0:1788361092.285880:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361092.285890:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+5:18601:x1875232144070400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361092.285906:0:18612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361092.285926:0:18612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ac06c8000/0xf6a94c97d6611971 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661196a expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.285952:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ac06c8000/0xf6a94c97d6611971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661196a expref: 6 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.285962:0:18612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ac06c8000/0xf6a94c97d6611971 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661196a expref: 6 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.285971:0:18612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac06c8000, rc 0) 00000100:00100000:1.0:1788361092.286043:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+6:18601:x1875232144070400:12345-0@lo:101:mount.lustre.0 Request processed in 154us (1834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361092.286050:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361092.286238:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361092.286257:0:18601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611971 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.286281:0:18601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611971 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361092.286344:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361092.286377:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361092.287004:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361092.287896:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144070528 00000100:00100000:1.0:1788361092.287906:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144070528 00000100:00100000:1.0:1788361092.287956:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361092.287964:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+6:18601:x1875232144070528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361092.288293:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+6:18601:x1875232144070528:12345-0@lo:501:mount.lustre.0 Request processed in 329us (1915us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361092.288301:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361092.289825:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070528:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788361092.289874:0:18601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788361092.289895:0:18601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611971 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.289921:0:18601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611971 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361092.289930:0:18601:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8ab6fbc800 10000000:01000000:0.0:1788361092.289936:0:18601:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788361092.289941:0:18601:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a8ab6fbc800 10000000:01000000:0.0:1788361092.289943:0:18601:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788361092.289946:0:18601:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a8ab6fbc800 from 1 10000000:01000000:0.0:1788361092.289948:0:18601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788361092.289985:0:18601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d6611978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.289993:0:18601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d6611978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.290001:0:18601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d6611978 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361092.290021:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361092.290070:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.290192:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf1540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361092.294015:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144070656 00000100:00100000:1.0:1788361092.294031:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144070656 00000100:00100000:1.0:1788361092.294172:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361092.294184:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+6:18601:x1875232144070656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361092.294201:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361092.294220:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ac06c8e00/0xf6a94c97d661197f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611978 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.294247:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ac06c8e00/0xf6a94c97d661197f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611978 expref: 7 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.294257:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ac06c8e00/0xf6a94c97d661197f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611978 expref: 7 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.294266:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac06c8e00, rc 0) 00000100:00100000:1.0:1788361092.294335:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+7:18601:x1875232144070656:12345-0@lo:101:mount.lustre.0 Request processed in 154us (4265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361092.294342:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361092.294369:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361092.294391:0:18601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d6611978 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661197f expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.294401:0:18601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d6611978 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661197f expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361092.294420:0:18601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788361092.294438:0:18601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d6611978 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661197f expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.294446:0:18601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d6611978 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661197f expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361092.294453:0:18601:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788361092.294458:0:18601:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788361092.294463:0:18601:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a8ab6fbc800 10000000:01000000:2.0:1788361092.294466:0:18601:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788361092.294470:0:18601:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788361092.294473:0:18601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788361092.294500:0:18601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6611986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.294537:0:18601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6611986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.294546:0:18601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6611986 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361092.294567:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361092.294601:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361092.294755:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361092.295874:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144070784 00000100:00100000:0.0:1788361092.295883:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144070784 00000100:00100000:0.0:1788361092.295924:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361092.295933:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+7:18601:x1875232144070784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361092.295947:0:18612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361092.295961:0:18612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b8a00/0xf6a94c97d661198d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611986 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.296001:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b8a00/0xf6a94c97d661198d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611986 expref: 8 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.296012:0:18612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b8a00/0xf6a94c97d661198d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611986 expref: 8 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.296020:0:18612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:0.0:1788361092.296080:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+8:18601:x1875232144070784:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361092.296108:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361092.296202:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361092.296220:0:18601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6611986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661198d expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361092.296229:0:18601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6611986 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661198d expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361092.296391:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361092.296426:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361092.296458:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788361092.296766:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144070912 00000100:00100000:0.0:1788361092.296771:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144070912 00000100:00100000:0.0:1788361092.296805:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361092.296812:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+8:18601:x1875232144070912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361092.297224:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+9:18601:x1875232144070912:12345-0@lo:501:mount.lustre.0 Request processed in 411us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361092.297232:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361092.297276:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144070912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361092.297995:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144071040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361092.298058:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.298213:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144071040 00000100:00100000:0.0:1788361092.298222:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144071040 00000100:00100000:3.0:1788361092.298240:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788361092.298766:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788361092.298776:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+9:18601:x1875232144071040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361092.299179:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+9:18601:x1875232144071040:12345-0@lo:503:mount.lustre.0 Request processed in 402us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361092.299187:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361092.299207:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144071040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361092.301990:0:18637:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18637:1875232144071168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361092.302078:0:18637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361092.304556:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144071168 00000100:00100000:2.0:1788361092.304569:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144071168 00000100:00100000:2.0:1788361092.304694:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361092.304704:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+9:18637:x1875232144071168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361092.305457:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+9:18637:x1875232144071168:12345-0@lo:502:llog_process_th.0 Request processed in 753us (3378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361092.305465:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361092.306851:0:18637:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361092.306888:0:18637:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18637:1875232144071168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361092.306932:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361092.306944:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361092.306947:0:18637:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788361092.306953:0:18637:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788361092.306956:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361092.306970:0:18637:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a8ab77a3380) 00000020:00000080:2.0:1788361092.306993:0:18637:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788361092.306999:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788361092.307075:0:18637:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788361092.309437:0:18637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d661199b 00000020:00000080:3.0:1788361092.309664:0:18637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788361092.309675:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361092.309681:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361092.309683:0:18637:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788361092.309690:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361092.309696:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361092.309708:0:18637:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788361092.309714:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361092.309725:0:18637:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a8984a5cd40) 00000020:00000080:3.0:1788361092.309749:0:18637:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788361092.309756:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788361092.309758:0:18637:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788361092.309761:0:18637:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788361092.309767:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788361092.309829:0:18637:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8ab6fbc800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788361092.309842:0:18637:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a8984a599c0) 00000020:00000080:3.0:1788361092.309850:0:18637:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788361092.309892:0:18637:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788361092.309898:0:18637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66119b0 00000020:00000080:3.0:1788361092.309998:0:18637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788361092.310005:0:18637:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788361092.310009:0:18637:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf6a94c97d66119b7 00080000:01000000:3.0:1788361092.310015:0:18637:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788361092.310018:0:18637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66119be 00010000:00010000:2.0:1788361092.364712:0:18637:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788361092.365295:0:18637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:2.0:1788361092.365479:0:18637:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788361092.366316:0:18637:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a8ab77a19c0) 00000020:00000080:2.0:1788361092.366334:0:18637:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788361092.366412:0:18637:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788361092.366420:0:18637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66119cc 00000020:00000080:2.0:1788361092.367007:0:18637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788361092.377611:0:18637:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf6a94c97d66119d3 00000020:00000080:1.0:1788361092.378362:0:18637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788361092.378373:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361092.378380:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361092.378382:0:18637:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788361092.378386:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361092.378391:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361092.378393:0:18637:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788361092.378397:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788361092.378446:0:18637:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788361092.378462:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361092.378466:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361092.378467:0:18637:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788361092.378476:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788361092.378478:0:18637:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788361092.378479:0:18637:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361092.378481:0:18637:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361092.378483:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788361092.378485:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361092.378487:0:18637:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788361092.378489:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788361092.378492:0:18637:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788361092.378495:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361092.378497:0:18637:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788361092.378500:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788361092.378506:0:18637:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:1.0:1788361092.378531:0:18637:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788361092.378534:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788361092.378548:0:18637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a8a857119c0) 00000020:00000080:1.0:1788361092.378561:0:18637:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788361092.378566:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788361092.378625:0:18637:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788361092.378631:0:18637:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788361092.378637:0:18637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66119e1 00010000:00080000:1.0:1788361092.378668:0:18637:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8ac05c4800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1788361092.378899:0:18637:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788361092.379448:0:18637:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788361092.379496:0:18637:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788361092.380540:0:18637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361092.380597:0:18637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788361092.380664:0:18637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788361092.381476:0:18641:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788361092.381482:0:18641:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788361092.383779:0:18637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361092.383795:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788361092.383854:0:18637:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788361092.383874:0:18637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66119e8 00000100:00080000:3.0:1788361092.383884:0:18637:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361092.383891:0:18637:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8ac05c4800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361092.383928:0:18637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8986707800 x1875232144071296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361092.384015:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144071296:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788361092.384099:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144071296 offset 0 length 520: 4 00000100:00080000:3.0:1788361092.384197:0:18637:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788361092.384251:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361092.384255:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361092.384257:0:18637:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788361092.384260:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788361092.384263:0:18637:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788361092.384270:0:18637:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361092.384272:0:18637:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361092.384273:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788361092.384276:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361092.384277:0:18637:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788361092.384280:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788361092.384284:0:18637:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788361092.384288:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361092.384289:0:18637:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788361092.384292:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788361092.384296:0:18637:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:3.0:1788361092.384316:0:18637:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788361092.384319:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361092.384331:0:18637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a8984a58000) 00000020:00000080:3.0:1788361092.384343:0:18637:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788361092.384347:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788361092.384397:0:18637:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788361092.384403:0:18637:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788361092.384409:0:18637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66119f6 00010000:00080000:3.0:1788361092.384436:0:18637:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8ac05c3000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361092.384636:0:18637:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788361092.384830:0:18637:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788361092.384851:0:18637:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788361092.385406:0:18637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361092.385468:0:18637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788361092.385534:0:18637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788361092.389605:0:18643:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788361092.389629:0:18643:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788361092.391075:0:18637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361092.391155:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788361092.391193:0:18637:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788361092.391213:0:18637:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66119fd 00000100:00080000:3.0:1788361092.391222:0:18637:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361092.391228:0:18637:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8ac05c3000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361092.391270:0:18637:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8986705c00 x1875232144071424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361092.391331:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144071424:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788361092.391385:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144071424 offset 0 length 520: 4 00000100:00080000:3.0:1788361092.391435:0:18637:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788361092.391519:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361092.391523:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361092.391525:0:18637:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788361092.391528:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361092.391532:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361092.391533:0:18637:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788361092.391536:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788361092.391537:0:18637:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788361092.391539:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361092.391541:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361092.391543:0:18637:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788361092.391545:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361092.391547:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361092.391548:0:18637:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788361092.391552:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788361092.391579:0:18637:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18637:1875232144071552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361092.391627:0:18637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361092.391657:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144071552 00000100:00100000:3.0:1788361092.391664:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144071552 00000100:00100000:3.0:1788361092.391694:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361092.391702:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+9:18637:x1875232144071552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361092.392128:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+9:18637:x1875232144071552:12345-0@lo:502:llog_process_th.0 Request processed in 424us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361092.392137:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361092.392179:0:18637:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a0a3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361092.392202:0:18637:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18637:1875232144071552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361092.392240:0:18637:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361092.392245:0:18637:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361092.392246:0:18637:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788361092.392251:0:18637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788361092.392303:0:18601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788361092.392320:0:18601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788361092.392335:0:18601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6611986 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661198d expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361092.392346:0:18601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6611986 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661198d expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361092.392354:0:18601:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8ab6fbc800 from 1 10000000:01000000:3.0:1788361092.392356:0:18601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361092.392382:0:18601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361092.392390:0:18601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361092.392399:0:18601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361092.392413:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144071680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361092.392442:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361092.392456:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a0a3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361092.392481:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144071680 00000100:00100000:3.0:1788361092.392484:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144071680 00000100:00100000:3.0:1788361092.392508:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361092.392515:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+9:18601:x1875232144071680:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361092.392531:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361092.392545:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d6611a0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611a04 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361092.392579:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d6611a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611a04 expref: 10 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361092.392591:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d6611a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611a04 expref: 10 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361092.392599:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e000, rc 0) 00000100:00100000:3.0:1788361092.392629:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+10:18601:x1875232144071680:12345-0@lo:101:mount.lustre.0 Request processed in 114us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361092.392635:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361092.392665:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144071680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361092.392676:0:18601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361092.392684:0:18601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361092.393569:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144071808:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788361092.393616:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361092.393691:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a0a3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788361092.394369:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144071808 00000100:00100000:0.0:1788361092.394378:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144071808 00000100:00100000:0.0:1788361092.394427:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788361092.394436:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+10:18601:x1875232144071808:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788361092.394455:0:18613:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788361092.394461:0:18613:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788361092.394552:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+10:18601:x1875232144071808:12345-0@lo:256:mount.lustre.0 Request processed in 117us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361092.394560:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788361092.394651:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144071808:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788361092.395310:0:18601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788361092.395325:0:18601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.395336:0:18601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361092.395344:0:18601:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8ab6fbc800 from 1 10000000:01000000:2.0:1788361092.395346:0:18601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788361092.395375:0:18601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.395384:0:18601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.395394:0:18601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361092.395426:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144071936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361092.395464:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361092.395491:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361092.395704:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144071936 00000100:00100000:0.0:1788361092.395710:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144071936 00000100:00100000:0.0:1788361092.395746:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361092.395754:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+10:18601:x1875232144071936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361092.395765:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361092.395777:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b8000/0xf6a94c97d6611a19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611a12 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.395797:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b8000/0xf6a94c97d6611a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611a12 expref: 11 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.395818:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b8000/0xf6a94c97d6611a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611a12 expref: 11 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.395828:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8000, rc 0) 00000100:00100000:0.0:1788361092.395864:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18601:x1875232144071936:12345-0@lo:101:mount.lustre.0 Request processed in 111us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361092.395871:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361092.396067:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144071936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361092.396081:0:18601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.396121:0:18601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361092.396173:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144072064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361092.396199:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361092.396216:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361092.396275:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144072064 00000100:00100000:1.0:1788361092.396280:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144072064 00000100:00100000:1.0:1788361092.396300:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361092.396306:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18601:x1875232144072064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361092.396683:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18601:x1875232144072064:12345-0@lo:501:mount.lustre.0 Request processed in 376us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361092.396690:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361092.396948:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144072064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361092.396982:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144072192:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361092.397345:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361092.397377:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361092.397463:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144072192 00000100:00100000:1.0:1788361092.397468:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144072192 00000100:00100000:1.0:1788361092.397502:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361092.397509:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18601:x1875232144072192:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361092.397687:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18601:x1875232144072192:12345-0@lo:503:mount.lustre.0 Request processed in 178us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361092.397694:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788361092.397950:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144072192:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361092.398380:0:18645:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18645:1875232144072320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361092.398423:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.398456:0:18645:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361092.399375:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144072320 00000100:00100000:2.0:1788361092.399384:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144072320 00000100:00100000:2.0:1788361092.399431:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361092.399440:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18645:x1875232144072320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361092.399709:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18645:x1875232144072320:12345-0@lo:502:llog_process_th.0 Request processed in 269us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361092.399726:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361092.399871:0:18645:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18645:1875232144072320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361092.399902:0:18645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361092.399912:0:18645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361092.399914:0:18645:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788361092.399922:0:18645:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8ab6fbc800 00000020:00000080:0.0:1788361092.399924:0:18645:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361092.399933:0:18645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361092.399936:0:18645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361092.399937:0:18645:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788361092.399939:0:18645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361092.399942:0:18645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361092.399943:0:18645:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788361092.399946:0:18645:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8ab6fbc800 00000020:00000080:0.0:1788361092.399948:0:18645:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361092.400016:0:18645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361092.400020:0:18645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361092.400022:0:18645:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788361092.400024:0:18645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361092.400026:0:18645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361092.400027:0:18645:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788361092.400031:0:18645:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8ab6fbc800 00000020:00000080:0.0:1788361092.400033:0:18645:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788361092.400073:0:18645:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18645:1875232144072448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361092.400135:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.400159:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144072448 00000100:00100000:0.0:1788361092.400163:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144072448 00000100:00100000:0.0:1788361092.400182:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361092.400189:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18645:x1875232144072448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361092.400309:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18645:x1875232144072448:12345-0@lo:502:llog_process_th.0 Request processed in 120us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361092.400325:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361092.400362:0:18645:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361092.400374:0:18645:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18645:1875232144072448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361092.400390:0:18645:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361092.400394:0:18645:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361092.400396:0:18645:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788361092.400399:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788361092.406205:0:18601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788361092.406243:0:18601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361092.406461:0:18601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.406475:0:18601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361092.406519:0:18601:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788361092.406522:0:18601:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8ab6fbc800 10000000:01000000:0.0:1788361092.406525:0:18601:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8ab6fbc800 10000000:01000000:0.0:1788361092.406528:0:18601:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361092.406534:0:18601:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8ab6fbc800 from 1 10000000:01000000:0.0:1788361092.406537:0:18601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361092.406572:0:18601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d6611a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.406581:0:18601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d6611a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.406592:0:18601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d6611a20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361092.406629:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144072576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361092.406706:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.406757:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361092.406783:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144072576 00000100:00100000:0.0:1788361092.406800:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144072576 00000100:00100000:0.0:1788361092.406842:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361092.406850:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18601:x1875232144072576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361092.407134:0:18612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361092.407151:0:18612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6611a27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611a20 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.407176:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6611a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611a20 expref: 12 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.407188:0:18612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6611a27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611a20 expref: 12 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.407195:0:18612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:0.0:1788361092.407242:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18601:x1875232144072576:12345-0@lo:101:mount.lustre.0 Request processed in 391us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361092.407251:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361092.407308:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144072576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361092.407324:0:18601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d6611a20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a27 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.407332:0:18601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d6611a20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611a27 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361092.407392:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144072704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361092.407423:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.407447:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361092.407456:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144072704 00000100:00100000:1.0:1788361092.407463:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144072704 00000100:00100000:1.0:1788361092.407499:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361092.407507:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18601:x1875232144072704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361092.407774:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18601:x1875232144072704:12345-0@lo:501:mount.lustre.0 Request processed in 267us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361092.407782:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361092.408612:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144072704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361092.408657:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144072832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361092.408720:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.408749:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361092.408769:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144072832 00000100:00100000:0.0:1788361092.409999:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144072832 00000100:00100000:0.0:1788361092.410059:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361092.410068:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18601:x1875232144072832:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361092.410496:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18601:x1875232144072832:12345-0@lo:503:mount.lustre.0 Request processed in 428us (1774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361092.410504:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361092.410900:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144072832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361092.411146:0:18648:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18648:1875232144072960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361092.411387:0:18648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.411411:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144072960 00000100:00100000:0.0:1788361092.411417:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144072960 00000100:00100000:0.0:1788361092.411447:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788361092.411456:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18648:x1875232144072960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361092.412026:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18648:x1875232144072960:12345-0@lo:502:llog_process_th.0 Request processed in 569us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361092.412043:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788361092.412114:0:18648:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361092.412135:0:18648:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18648:1875232144072960:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788361092.412264:0:18648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788361092.412279:0:18648:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a8a90bf19c0) 00000020:00000080:0.0:1788361092.412365:0:18648:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788361092.412757:0:18648:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8ab6fbc800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788361092.412762:0:18648:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8ab6fbc800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788361092.412766:0:18648:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8ab6fbc800 4 00010000:00080000:0.0:1788361092.412802:0:18648:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8ac0c02800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:0.0:1788361092.418043:0:18648:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788361092.418595:0:18648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788361092.418657:0:18648:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788361092.418672:0:18648:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf6a94c97d6611a35 00000100:00080000:0.0:1788361092.418683:0:18648:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361092.418690:0:18648:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a8ac0c02800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361092.418729:0:18648:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a89858ace00 x1875232144073088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361092.418773:0:18648:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788361092.418960:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144073088:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361092.418972:0:18648:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18648:1875232144073216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361092.419036:0:18648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.419075:0:18648:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361092.419321:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.419455:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144073088 00000100:00100000:0.0:1788361092.419462:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144073088 00000100:00100000:0.0:1788361092.419499:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361092.419504:0:18620:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788361092.419507:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144073088:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361092.419515:0:18620:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788361092.419581:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144073088:12345-0@lo:38:llog_process_th.0 Request processed in 73us (258us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788361092.419589:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361092.419627:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361092.419634:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac0c02800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361092.419639:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788361092.419643:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144073088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361092.419908:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144073216 00000100:00100000:3.0:1788361092.419914:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144073216 00000100:00100000:3.0:1788361092.419992:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788361092.420010:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18648:x1875232144073216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361092.420270:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18648:x1875232144073216:12345-0@lo:502:llog_process_th.0 Request processed in 270us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361092.420277:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788361092.421152:0:18648:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18648:1875232144073216:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788361092.421189:0:18648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788361092.421480:0:18601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788361092.421497:0:18601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361092.421521:0:18601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d6611a20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a27 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.421532:0:18601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d6611a20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a27 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788361092.421573:0:18601:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788361092.421575:0:18601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361092.421577:0:18601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361092.421578:0:18601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361092.421579:0:18601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361092.421580:0:18601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361092.421581:0:18601:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361092.421583:0:18601:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361092.421584:0:18601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361092.421585:0:18601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361092.421590:0:18601:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788361092.421592:0:18601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361092.421593:0:18601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788361092.421594:0:18601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361092.421596:0:18601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361092.421597:0:18601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361092.421598:0:18601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361092.421599:0:18601:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788361092.421600:0:18601:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788361092.421601:0:18601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361092.421602:0:18601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361092.421621:0:18601:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788361092.421638:0:18601:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144073344:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361092.421690:0:18601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361092.421729:0:18601:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361092.421769:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144073344 00000100:00100000:0.0:1788361092.421775:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144073344 00000100:00100000:0.0:1788361092.421806:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788361092.421873:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18601:x1875232144073344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361092.421898:0:18613:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788361092.421910:0:18613:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788361092.461391:0:18613:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788361092.461411:0:18613:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788361092.461456:0:18635:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788361092.461462:0:18635:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788361092.461489:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.461508:0:18635:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d6611a0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611a04 expref: 12 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.461515:0:18635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.461553:0:18635:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d6611a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6611a04 expref: 12 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361092.461566:0:18635:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d6611a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6611a04 expref: 12 pid: 18613 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361092.461581:0:18635:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18635:1875232144073472:0@lo:104: 00000100:00100000:2.0:1788361092.461644:0:18635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361092.461693:0:18635:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361092.462119:0:18602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144073472 00000100:00100000:0.0:1788361092.462127:0:18602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144073472 00000100:00100000:0.0:1788361092.462168:0:18602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361092.462177:0:18602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+3:18635:x1875232144073472:12345-0@lo:104: 00010000:00010000:0.0:1788361092.462190:0:18602:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361092.462258:0:18602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361092.462265:0:18602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+3:18635:x1875232144073472:12345-0@lo:104: Request processed in 89us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361092.462271:0:18602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361092.462403:0:18635:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18635:1875232144073472:0@lo:104: 00010000:00010000:2.0:1788361092.462423:0:18635:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462473:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361092.462480:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462487:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ea00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361092.462491:0:18608:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462499:0:18608:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361092.462506:0:18608:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361092.462512:0:18608:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361092.462544:0:18608:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462550:0:18608:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361092.462573:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462591:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ea00/0xf6a94c97d6611a04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a0b expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462606:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361092.462607:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361092.462609:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361092.462632:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3313:1875232144073600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361092.462664:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361092.462718:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144073600 00000100:00100000:1.0:1788361092.462722:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144073600 00010000:00010000:1.0:1788361092.462749:0:18604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d6611a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611a04 expref: 13 pid: 18613 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361092.462771:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361092.462777:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+13:3313:x1875232144073600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361092.462787:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361092.462793:0:18604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d6611a0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611a04 expref: 13 pid: 18613 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462802:0:18604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d6611a0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6611a04 expref: 13 pid: 18613 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462814:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1e000/0xf6a94c97d6611a0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6611a04 expref: 13 pid: 18613 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462826:0:18604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462844:0:18604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361092.462857:0:18604:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001395913s 00010000:00010000:1.0:1788361092.462862:0:18604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462868:0:18604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462874:0:18604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462881:0:18604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462887:0:18604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361092.462890:0:18604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462897:0:18604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462911:0:18604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.462919:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361092.462947:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:3313:x1875232144073600:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361092.462954:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361092.462996:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3313:1875232144073600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361092.463165:0:18635:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.463173:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361092.463179:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573ec00/0xf6a94c97d6611a3c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361092.469314:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18601:x1875232144073344:12345-0@lo:253:mount.lustre.0 Request processed in 47432us (47612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361092.469328:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788361092.469407:0:18601:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ad180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18601:1875232144073344:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788361092.469422:0:18601:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788361092.469425:0:18601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788361092.469427:0:18601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361092.469440:0:18601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361092.469442:0:18601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361092.469443:0:18601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361092.469445:0:18601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361092.469446:0:18601:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361092.469447:0:18601:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361092.469449:0:18601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361092.469451:0:18601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788361092.469464:0:18601:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788361092.473442:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361092.473577:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361092.475883:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361092.476229:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361092.476520:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361092.476681:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361092.485440:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361092.485619:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361092.485905:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361092.486153:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361092.486420:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361092.486578:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788361092.513844:0:18601:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967527 00000040:01000000:1.0:1788361092.514502:0:18601:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788361092.514794:0:18658:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788361092.514862:0:18658:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361092.516954:0:18658:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788361092.517027:0:18658:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788361092.517032:0:18658:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788361092.519583:0:18601:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788361092.519712:0:18601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788361092.520182:0:18601:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788361092.520190:0:18601:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788361092.520310:0:18601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788361092.521012:0:18657:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967527 00000020:00080000:2.0:1788361092.521017:0:18657:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00000040:00080000:3.0:1788361092.521897:0:18601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788361092.522592:0:18601:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788361092.522630:0:18601:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788361092.523212:0:18601:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:3.0:1788361092.523970:0:18601:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:2.0:1788361092.529312:0:18601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788361092.563485:0:18601:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788361092.563525:0:18601:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa998c1e07988 00100000:10000000:1.0:1788361092.563532:0:18601:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788361092.564525:0:18601:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788361092.564540:0:18601:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788361092.564553:0:18601:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788361092.564569:0:18601:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788361093.153326:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361093.472478:0:18654:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788361093.472487:0:18654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361093.473985:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788361093.473996:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:2.0:1788361093.664149:0:18616:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788361093.664156:0:18616:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8ab6fbc800 from 9 10000000:01000000:2.0:1788361093.664162:0:18616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788361093.664204:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361093.664223:0:18616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361093.664234:0:18616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361093.664259:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144073728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361093.664330:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361093.664389:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361093.664464:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144073728 00000100:00100000:0.0:1788361093.664472:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144073728 00000100:00100000:0.0:1788361093.664536:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361093.664545:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18616:x1875232144073728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361093.664558:0:18614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361093.664571:0:18614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6611a4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611a43 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361093.664594:0:18614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6611a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611a43 expref: 12 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361093.664605:0:18614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6611a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611a43 expref: 12 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361093.664614:0:18614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9e00, rc 0) 00000100:00100000:0.0:1788361093.664657:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18616:x1875232144073728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361093.664664:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788361093.664830:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144073728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361093.664843:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361093.664863:0:18616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361093.664922:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144073856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788361093.664949:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361093.664969:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361093.665020:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144073856 00000100:00100000:0.0:1788361093.665024:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144073856 00000100:00100000:0.0:1788361093.665054:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788361093.665060:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18616:x1875232144073856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788361093.665117:0:18613:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788361093.665132:0:18613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788361093.665135:0:18613:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788361093.665433:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18616:x1875232144073856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 372us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361093.665441:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361093.665482:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144073856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788361093.665527:0:18616:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788361093.665535:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361093.665544:0:18616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361094.178835:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361094.500990:0:18654:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788361094.501000:0:18654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361094.501032:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788361094.501040:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788361095.205949:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788361095.766488:0:18901:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788361096.226987:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361097.248849:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361097.889881:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361097.889888:0:15670:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788361097.889890:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361097.889893:0:15670:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788361097.889895:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788361097.889898:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361097.889902:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8ac0c02800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361097.889912:0:15670:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a8ac0c02800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361097.889932:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8abc894000 x1875232144074112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361097.889973:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144074112:0@lo:38:kworker.0 00000100:00100000:2.0:1788361097.890104:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361097.890266:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361097.890277:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3313:1875232144073984:0@lo:400:kworker.0 00000100:00100000:3.0:1788361097.890312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361097.890365:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144073984 00000100:00100000:3.0:1788361097.890373:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144073984 00000100:00100000:3.0:1788361097.890413:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788361097.890424:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:3313:x1875232144073984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361097.890477:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:3313:x1875232144073984:12345-0@lo:400:kworker.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361097.890484:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788361097.890528:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3313:1875232144073984:0@lo:400:kworker.0 00000100:00100000:1.0:1788361097.893059:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144074112 00000100:00100000:1.0:1788361097.893075:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144074112 00000100:00100000:1.0:1788361097.893283:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361097.893292:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144074112:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788361097.893320:0:18621:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1788361097.893353:0:18621:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf6a94c97d6611a51 00000004:00100000:1.0:1788361097.893368:0:18621:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788361097.893499:0:18621:0:(import.c:65:import_set_state_nolock()) ffff9a89852f2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361097.893642:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875232144074112:12345-0@lo:38:kworker.0 Request processed in 338us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361097.893650:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788361097.895804:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8abc894000 x1875232144074112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361097.895826:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788361097.895834:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788361097.895840:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361097.895843:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac0c02800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361097.895850:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144074112:0@lo:38:kworker.0 00000020:00000080:3.0:1788361097.912519:0:19051:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdba4241a0 20000000:00000080:3.0:1788361097.912535:0:19051:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8ab647ac00 uarg=0000000000000000 20000000:01000000:3.0:1788361097.912567:0:19051:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788361097.912572:0:19051:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788361097.912577:0:19051:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788361097.913470:0:19052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788361097.914066:0:19051:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788361097.917815:0:19051:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788361097.917863:0:19051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361097.917883:0:19051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a841b8000/0xf6a94c97d6611a19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611a12 expref: 11 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361097.917892:0:19051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361097.917939:0:19051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a841b8000/0xf6a94c97d6611a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6611a12 expref: 11 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361097.917955:0:19051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a841b8000/0xf6a94c97d6611a19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6611a12 expref: 11 pid: 18613 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361097.918029:0:19051:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19051:1875232144074240:0@lo:104: 00000100:00100000:3.0:1788361097.918219:0:19051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361097.918257:0:19051:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90b6d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361097.918321:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144074240 00000100:00100000:1.0:1788361097.918329:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144074240 00000100:00100000:1.0:1788361097.918385:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361097.918395:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+3:19051:x1875232144074240:12345-0@lo:104: 00010000:00010000:1.0:1788361097.918408:0:18603:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361097.918465:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361097.918471:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+3:19051:x1875232144074240:12345-0@lo:104: Request processed in 78us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361097.918479:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361097.918555:0:19051:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19051:1875232144074240:0@lo:104: 00010000:00010000:3.0:1788361097.918572:0:19051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.918785:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361097.918793:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.918800:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361097.918804:0:18608:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.918813:0:18608:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361097.918820:0:18608:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361097.918825:0:18608:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361097.918893:0:18608:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.918900:0:18608:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361097.918927:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.918935:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6611a12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a19 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.918960:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361097.918972:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361097.918974:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361097.918996:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361097.919005:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3312:1875232144074368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361097.919038:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361097.919081:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144074368 00000100:00100000:0.0:1788361097.919115:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144074368 00010000:00010000:0.0:1788361097.919135:0:18606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a841b8000/0xf6a94c97d6611a19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611a12 expref: 12 pid: 18613 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361097.919157:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361097.919163:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:3312:x1875232144074368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361097.919174:0:18606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361097.919179:0:18606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a841b8000/0xf6a94c97d6611a19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611a12 expref: 12 pid: 18613 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919189:0:18606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a841b8000/0xf6a94c97d6611a19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6611a12 expref: 12 pid: 18613 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919201:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8000/0xf6a94c97d6611a19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6611a12 expref: 12 pid: 18613 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919214:0:18606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919222:0:18606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919251:0:18606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919257:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919263:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919269:0:18606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919274:0:18606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361097.919278:0:18606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919285:0:18606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919306:0:18606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361097.919315:0:18606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361097.919345:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:3312:x1875232144074368:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361097.919353:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361097.919395:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3312:1875232144074368:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361097.919737:0:19051:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361097.919745:0:19051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361097.919752:0:19051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d6611a58 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361098.272444:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361099.298163:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788361099.360262:0:18616:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361099.360271:0:18616:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8ab6fbc800 from 10 10000000:01000000:3.0:1788361099.360276:0:18616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361099.360320:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361099.360332:0:18616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361099.360360:0:18616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361099.360385:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144074496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361099.360450:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361099.360545:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90b6d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361099.362128:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144074496 00000100:00100000:2.0:1788361099.362139:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144074496 00000100:00100000:2.0:1788361099.362201:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788361099.362212:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+11:18616:x1875232144074496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361099.362230:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361099.362247:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d6611a66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611a5f expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361099.362272:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d6611a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611a5f expref: 12 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361099.362283:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d6611a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611a5f expref: 12 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361099.362293:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:2.0:1788361099.362358:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18616:x1875232144074496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361099.362364:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788361099.362473:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144074496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361099.362490:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361099.362498:0:18616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361099.362577:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144074624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361099.362609:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361099.362643:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361099.363046:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144074624 00000100:00100000:3.0:1788361099.363052:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144074624 00000100:00100000:3.0:1788361099.363108:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788361099.363117:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18616:x1875232144074624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361099.363626:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18616:x1875232144074624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 509us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361099.363634:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788361099.365216:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144074624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361099.365280:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144074752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361099.365367:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361099.365409:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361099.366267:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144074752 00000100:00100000:3.0:1788361099.366276:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144074752 00000100:00100000:3.0:1788361099.366326:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788361099.366335:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18616:x1875232144074752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361099.366550:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:18616:x1875232144074752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361099.366558:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788361099.366620:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144074752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361099.368846:0:19124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788361099.369049:0:18616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788361099.369070:0:18616:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361099.369079:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361099.369107:0:18616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361100.326333:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788361101.135515:0:19251:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788361101.135519:0:19251:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788361101.135634:0:19251:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8a8370e000 00000020:01000004:1.0:1788361101.135651:0:19251:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788361101.135665:0:19251:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788361101.135693:0:19251:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a8a85714d40) 00000020:00000080:1.0:1788361101.135710:0:19251:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788361101.152757:0:19251:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788361101.153053:0:19251:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788361101.154399:0:19251:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788361101.154643:0:19251:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788361101.154935:0:19251:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1788361101.155523:0:19251:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1788361101.155668:0:19251:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1788361101.157175:0:19251:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:1.0:1788361101.160210:0:19251:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 720: rc = 0 00100000:10000000:1.0:1788361101.160487:0:19251:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 720: rc = 0 00100000:10000000:1.0:1788361101.160782:0:19251:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 720: rc = 0 00100000:10000000:1.0:1788361101.161038:0:19251:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 720: rc = 0 00100000:10000000:1.0:1788361101.161297:0:19251:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 720: rc = 0 00100000:10000000:1.0:1788361101.161549:0:19251:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 720: rc = 0 00000020:00000080:1.0:1788361101.163351:0:19251:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788361101.163364:0:19251:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788361101.163376:0:19251:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d6611a74 00000020:01000004:1.0:1788361101.163386:0:19251:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788361101.163412:0:19251:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788361101.163416:0:19251:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788361101.163421:0:19251:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788361101.163427:0:19251:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788361101.163438:0:19251:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a8a85713380) 00000020:00000080:1.0:1788361101.163449:0:19251:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788361101.166485:0:19251:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361101.166642:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788361101.166648:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788361101.174192:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788361101.174207:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788361101.174658:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788361101.174666:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788361101.180544:0:19251:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361101.180746:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788361101.180752:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788361101.185021:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788361101.185034:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788361101.207068:0:19251:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361101.207408:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788361101.207416:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788361101.209204:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788361101.209264:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788361101.210342:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788361101.210351:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788361101.212571:0:19251:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361101.212752:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788361101.212765:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788361101.215539:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788361101.215551:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788361101.249486:0:19251:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361101.249648:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788361101.249654:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788361101.250572:0:19251:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788361101.250580:0:19251:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788361101.250928:0:19251:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788361101.250950:0:19251:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788361101.250957:0:19251:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788361101.257499:0:19251:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788361101.257543:0:19251:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788361101.257547:0:19251:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788361101.257549:0:19251:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361101.257550:0:19251:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361101.257552:0:19251:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361101.257553:0:19251:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361101.257554:0:19251:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361101.257556:0:19251:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361101.257558:0:19251:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361101.257559:0:19251:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361101.257562:0:19251:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788361101.257565:0:19251:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361101.257566:0:19251:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361101.257571:0:19251:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361101.257572:0:19251:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361101.257573:0:19251:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361101.257574:0:19251:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361101.257575:0:19251:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361101.257576:0:19251:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361101.257577:0:19251:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361101.257605:0:19251:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788361101.257625:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144074880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788361101.257701:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361101.257812:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a831af000 going to sleep for 11 seconds 00000100:00100000:3.0:1788361101.257900:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144074880 00000100:00100000:3.0:1788361101.257908:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144074880 00000100:00100000:3.0:1788361101.258023:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788361101.258033:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:19251:x1875232144074880:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788361101.258062:0:18614:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788361101.258065:0:18614:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788361101.258068:0:18614:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788361101.265293:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:19251:x1875232144074880:12345-0@lo:253:mount.lustre.0 Request processed in 7253us (7583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361101.265306:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788361101.265394:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144074880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788361101.265410:0:19251:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788361101.265413:0:19251:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788361101.265415:0:19251:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361101.265416:0:19251:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361101.265417:0:19251:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361101.265419:0:19251:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361101.265420:0:19251:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361101.265421:0:19251:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361101.265423:0:19251:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361101.265424:0:19251:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788361101.265442:0:19251:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8a8370e000 from lustre-OST0000 10000000:01000000:2.0:1788361101.265469:0:19251:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788361101.265472:0:19251:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788361101.265478:0:19251:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8984a5b380 local copy 00010000:00010000:2.0:1788361101.265488:0:19251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611971 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361101.265672:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361101.265716:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361101.268132:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144075008 00000100:00100000:1.0:1788361101.268144:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144075008 00000100:00100000:0.0:1788361101.268735:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788361101.268748:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:19251:x1875232144075008:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361101.269009:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:19251:x1875232144075008:12345-0@lo:501:mount.lustre.0 Request processed in 264us (3291us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361101.269018:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788361101.269180:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84e2e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361101.269201:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075008:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788361101.269221:0:19251:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788361101.269387:0:19251:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788361101.269395:0:19251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611971 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.269405:0:19251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611971 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361101.269440:0:19251:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8a8370e000 10000000:01000000:2.0:1788361101.269444:0:19251:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788361101.269448:0:19251:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a8984a5b380 10000000:01000000:2.0:1788361101.269451:0:19251:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788361101.269454:0:19251:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a8984a5b380 from 1 10000000:01000000:2.0:1788361101.269457:0:19251:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788361101.269486:0:19251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fc00/0xf6a94c97d6611a82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.269494:0:19251:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fc00/0xf6a94c97d6611a82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.269503:0:19251:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fc00/0xf6a94c97d6611a82 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361101.269522:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361101.269558:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361101.269582:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84e2e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361101.269660:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144075136 00000100:00100000:0.0:1788361101.269665:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144075136 00000100:00100000:0.0:1788361101.269698:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788361101.269704:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+12:19251:x1875232144075136:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361101.269712:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361101.269723:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b8e00/0xf6a94c97d6611a89 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611a82 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361101.269741:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b8e00/0xf6a94c97d6611a89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611a82 expref: 13 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361101.269751:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b8e00/0xf6a94c97d6611a89 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611a82 expref: 13 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361101.269759:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8e00, rc 0) 00000100:00100000:0.0:1788361101.269790:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+13:19251:x1875232144075136:12345-0@lo:101:mount.lustre.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361101.269796:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788361101.269933:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361101.269952:0:19251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fc00/0xf6a94c97d6611a82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a89 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.269960:0:19251:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fc00/0xf6a94c97d6611a82 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611a89 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361101.269975:0:19251:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788361101.269989:0:19251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fc00/0xf6a94c97d6611a82 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a89 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.270007:0:19251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fc00/0xf6a94c97d6611a82 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a89 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361101.270013:0:19251:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788361101.270015:0:19251:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788361101.270019:0:19251:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788361101.270021:0:19251:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788361101.270033:0:19251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.270039:0:19251:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.270046:0:19251:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361101.270055:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075264:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361101.270077:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361101.270236:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84e2e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361101.270314:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144075264 00000100:00100000:3.0:1788361101.270319:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144075264 00000100:00100000:3.0:1788361101.270378:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361101.270385:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+13:19251:x1875232144075264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361101.270398:0:18614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361101.270406:0:18614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1f800/0xf6a94c97d6611a97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611a90 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361101.270421:0:18614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1f800/0xf6a94c97d6611a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611a90 expref: 14 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361101.270429:0:18614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1f800/0xf6a94c97d6611a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611a90 expref: 14 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361101.270436:0:18614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f800, rc 0) 00000100:00100000:3.0:1788361101.270470:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+14:19251:x1875232144075264:12345-0@lo:101:mount.lustre.0 Request processed in 86us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361101.270476:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788361101.270529:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075264:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361101.270539:0:19251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a97 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.270546:0:19251:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611a97 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361101.271133:0:19251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788361101.271907:0:19251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361101.272187:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788361101.272228:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788361101.272259:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788361101.272312:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788361101.272350:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788361101.272382:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788361101.272774:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788361101.272840:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788361101.272872:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788361101.272916:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788361101.273016:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788361101.273139:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788361101.273210:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788361101.273218:0:19251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788361101.273308:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361101.273368:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361101.273478:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84e2ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361101.273538:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144075392 00000100:00100000:1.0:1788361101.273545:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144075392 00000100:00100000:1.0:1788361101.273581:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361101.273589:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+14:19251:x1875232144075392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361101.274018:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+14:19251:x1875232144075392:12345-0@lo:501:mount.lustre.0 Request processed in 428us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361101.274027:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788361101.274259:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361101.274292:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361101.274332:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361101.274391:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84e2ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361101.274424:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144075520 00000100:00100000:0.0:1788361101.274430:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144075520 00000100:00100000:0.0:1788361101.274487:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788361101.274495:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+14:19251:x1875232144075520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361101.274822:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+14:19251:x1875232144075520:12345-0@lo:503:mount.lustre.0 Request processed in 327us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361101.274835:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788361101.274906:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788361101.275558:0:19251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788361101.275618:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361101.275665:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361101.275766:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84e2ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361101.275836:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144075648 00000100:00100000:0.0:1788361101.275842:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144075648 00000100:00100000:0.0:1788361101.275879:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361101.275886:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+14:19251:x1875232144075648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361101.276106:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+14:19251:x1875232144075648:12345-0@lo:502:mount.lustre.0 Request processed in 219us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361101.276113:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788361101.276267:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361101.276473:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788361101.276526:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788361101.276556:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788361101.276597:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788361101.276629:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788361101.276658:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788361101.276717:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788361101.276750:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788361101.276778:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1788361101.276832:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1788361101.276868:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1788361101.276921:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1788361101.276962:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361101.277000:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361101.277021:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84e2ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361101.277164:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144075776 00000100:00100000:1.0:1788361101.277170:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144075776 00000100:00100000:1.0:1788361101.277197:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788361101.277204:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+14:19251:x1875232144075776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361101.277362:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+14:19251:x1875232144075776:12345-0@lo:502:mount.lustre.0 Request processed in 158us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361101.277370:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788361101.277551:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361101.277613:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1788361101.277622:0:19251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788361101.278467:0:19265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788361101.278475:0:19265:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788361101.278481:0:19265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361101.278484:0:19265:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788361101.278488:0:19265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361101.278503:0:19265:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a8ab724b380) 00000020:00000080:2.0:1788361101.278525:0:19265:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788361101.278530:0:19265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788361101.278590:0:19265:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a8370e000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788361101.278596:0:19265:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788361101.278603:0:19265:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d6611aa5 00010000:00010000:2.0:1788361101.282155:0:19265:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788361101.282624:0:19265:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934593 00080000:10000000:2.0:1788361101.284650:0:19265:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1788361101.285975:0:19265:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788361101.285986:0:19265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361101.285993:0:19265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361101.285995:0:19265:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788361101.285998:0:19265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788361101.286002:0:19265:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788361101.286004:0:19265:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361101.286005:0:19265:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361101.286007:0:19265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788361101.286009:0:19265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361101.286011:0:19265:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788361101.286014:0:19265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361101.286017:0:19265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361101.286018:0:19265:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788361101.286021:0:19265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788361101.286023:0:19265:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788361101.286025:0:19265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361101.286028:0:19265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361101.286029:0:19265:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788361101.286031:0:19265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361101.286034:0:19265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361101.286035:0:19265:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788361101.286038:0:19265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788361101.286106:0:19265:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361101.286110:0:19265:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361101.286112:0:19265:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788361101.286116:0:19265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1788361101.286281:0:19251:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788361101.286306:0:19251:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788361101.286330:0:19251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a97 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361101.286342:0:19251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611a97 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361101.286351:0:19251:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a8370e000 from 1 10000000:01000000:0.0:1788361101.286353:0:19251:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361101.286385:0:19251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361101.286394:0:19251:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361101.286404:0:19251:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361101.286429:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361101.286502:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361101.286547:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361101.286726:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144075904 00000100:00100000:2.0:1788361101.286733:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144075904 00000100:00100000:2.0:1788361101.286777:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788361101.286786:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+14:19251:x1875232144075904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361101.286801:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361101.286814:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d6611ab3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611aac expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.286845:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d6611ab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611aac expref: 15 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.286854:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d6611ab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611aac expref: 15 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.286862:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e000, rc 0) 00000100:00100000:2.0:1788361101.286900:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:19251:x1875232144075904:12345-0@lo:101:mount.lustre.0 Request processed in 116us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361101.286907:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788361101.287072:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144075904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361101.287121:0:19251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361101.287131:0:19251:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361101.287632:0:19251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:0.0:1788361101.288280:0:19251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361101.288520:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788361101.288566:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1788361101.288617:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1788361101.288654:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1788361101.288700:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1788361101.288750:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1788361101.288788:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788361101.288820:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788361101.288882:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788361101.288890:0:19251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:0.0:1788361101.289201:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361101.289255:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361101.289347:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361101.294725:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144076032 00000100:00100000:0.0:1788361101.294741:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144076032 00000100:00100000:0.0:1788361101.294864:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788361101.294874:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:19251:x1875232144076032:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361101.295375:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:19251:x1875232144076032:12345-0@lo:501:mount.lustre.0 Request processed in 501us (6118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361101.295388:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788361101.295516:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361101.295564:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361101.295608:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361101.295644:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84e2ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361101.295695:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144076160 00000100:00100000:1.0:1788361101.295700:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144076160 00000100:00100000:1.0:1788361101.295733:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788361101.295741:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:19251:x1875232144076160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361101.295907:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:19251:x1875232144076160:12345-0@lo:503:mount.lustre.0 Request processed in 167us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361101.295914:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788361101.296255:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076160:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788361101.296768:0:19251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361101.296831:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361101.296875:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361101.296910:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83ef5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361101.297056:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144076288 00000100:00100000:2.0:1788361101.297061:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144076288 00000100:00100000:2.0:1788361101.297102:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788361101.297109:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:19251:x1875232144076288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361101.297262:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:19251:x1875232144076288:12345-0@lo:502:mount.lustre.0 Request processed in 152us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361101.297269:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788361101.297297:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361101.297492:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788361101.297545:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788361101.297604:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788361101.297646:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788361101.297695:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788361101.297745:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788361101.297779:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788361101.297809:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:3.0:1788361101.297839:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361101.297875:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361101.297906:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83ef5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361101.298026:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144076416 00000100:00100000:1.0:1788361101.298032:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144076416 00000100:00100000:1.0:1788361101.298067:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788361101.298074:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:19251:x1875232144076416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361101.298247:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:19251:x1875232144076416:12345-0@lo:502:mount.lustre.0 Request processed in 173us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361101.298255:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788361101.298344:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076416:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361101.298427:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788361101.298438:0:19251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788361101.299174:0:19269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361101.299184:0:19269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361101.299186:0:19269:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788361101.299192:0:19269:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a8370e000 00000020:00000080:0.0:1788361101.299194:0:19269:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361101.299201:0:19269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361101.299203:0:19269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361101.299205:0:19269:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788361101.299207:0:19269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361101.299209:0:19269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361101.299211:0:19269:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788361101.299214:0:19269:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a8370e000 00000020:00000080:0.0:1788361101.299216:0:19269:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361101.299257:0:19269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361101.299260:0:19269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361101.299262:0:19269:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788361101.299264:0:19269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361101.299267:0:19269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361101.299269:0:19269:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788361101.299272:0:19269:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8a8370e000 00000020:00000080:0.0:1788361101.299275:0:19269:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361101.299304:0:19269:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361101.299308:0:19269:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361101.299309:0:19269:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788361101.299312:0:19269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1788361101.299431:0:19251:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788361101.299453:0:19251:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361101.299475:0:19251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.299487:0:19251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361101.299526:0:19251:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788361101.299529:0:19251:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8a8370e000 10000000:01000000:1.0:1788361101.299533:0:19251:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8a8370e000 10000000:01000000:1.0:1788361101.299536:0:19251:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361101.299542:0:19251:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a8370e000 from 1 10000000:01000000:1.0:1788361101.299545:0:19251:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361101.299570:0:19251:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.299579:0:19251:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.299595:0:19251:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361101.299612:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361101.299653:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361101.299688:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa0acdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361101.299725:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144076544 00000100:00100000:3.0:1788361101.299731:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144076544 00000100:00100000:3.0:1788361101.299767:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788361101.299775:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:19251:x1875232144076544:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361101.299785:0:18612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361101.299798:0:18612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1ec00/0xf6a94c97d6611ac1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611aba expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361101.299819:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1ec00/0xf6a94c97d6611ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611aba expref: 16 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361101.299829:0:18612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1ec00/0xf6a94c97d6611ac1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611aba expref: 16 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361101.299837:0:18612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1ec00, rc 0) 00000100:00100000:3.0:1788361101.299877:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19251:x1875232144076544:12345-0@lo:101:mount.lustre.0 Request processed in 103us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361101.299884:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788361101.299923:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076544:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361101.299938:0:19251:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611ac1 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.300018:0:19251:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611ac1 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361101.300596:0:19251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:1.0:1788361101.302384:0:19251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361101.302699:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788361101.302746:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788361101.302780:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788361101.302844:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788361101.302881:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788361101.302927:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788361101.307070:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788361101.307230:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788361101.307326:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788361101.307364:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788361101.307400:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788361101.307451:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788361101.307489:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788361101.307522:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788361101.307568:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788361101.307602:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788361101.307636:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788361101.307694:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788361101.307732:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788361101.307766:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788361101.309032:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788361101.309122:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788361101.309157:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788361101.309209:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788361101.309266:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:0.0:1788361101.309303:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:0.0:1788361101.309353:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:0.0:1788361101.309388:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:0.0:1788361101.309421:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:0.0:1788361101.309466:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:0.0:1788361101.309501:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:0.0:1788361101.309533:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:0.0:1788361101.309566:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:0.0:1788361101.309618:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:0.0:1788361101.309655:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:0.0:1788361101.309720:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:0.0:1788361101.309761:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:0.0:1788361101.309798:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:0.0:1788361101.309848:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:0.0:1788361101.309885:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:0.0:1788361101.311305:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:0.0:1788361101.311328:0:19251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:0.0:1788361101.311437:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361101.311497:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361101.311537:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144076672 00000100:00100000:0.0:1788361101.311543:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144076672 00000100:00100000:0.0:1788361101.311591:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788361101.311598:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19251:x1875232144076672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361101.311827:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19251:x1875232144076672:12345-0@lo:501:mount.lustre.0 Request processed in 227us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361101.311835:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788361101.311874:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90b6d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361101.311895:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361101.311924:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076800:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361101.312003:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361101.312023:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90b6d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361101.312702:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144076800 00000100:00100000:3.0:1788361101.312708:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144076800 00000100:00100000:3.0:1788361101.312751:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788361101.312759:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19251:x1875232144076800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361101.312912:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19251:x1875232144076800:12345-0@lo:503:mount.lustre.0 Request processed in 154us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361101.312920:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788361101.313131:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076800:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788361101.313632:0:19251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788361101.314269:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361101.314327:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361101.314400:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90b6d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361101.325146:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144076928 00000100:00100000:2.0:1788361101.325163:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144076928 00000100:00100000:2.0:1788361101.325226:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788361101.325236:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19251:x1875232144076928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361101.325530:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19251:x1875232144076928:12345-0@lo:502:mount.lustre.0 Request processed in 295us (11202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361101.325539:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788361101.326176:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144076928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361101.326473:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788361101.326530:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788361101.326564:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788361101.326611:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788361101.326647:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788361101.326711:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788361101.326748:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788361101.326782:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788361101.326828:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788361101.326878:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788361101.326913:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788361101.328790:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788361101.328870:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788361101.328904:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788361101.329032:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788361101.329072:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788361101.329126:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788361101.329174:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788361101.329209:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788361101.329246:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788361101.329294:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788361101.329331:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788361101.329366:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788361101.329414:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788361101.329450:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:2.0:1788361101.329502:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:2.0:1788361101.329563:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:2.0:1788361101.329597:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:2.0:1788361101.329629:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:2.0:1788361101.329691:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:2.0:1788361101.329729:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:2.0:1788361101.329763:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:2.0:1788361101.329795:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:2.0:1788361101.329842:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:2.0:1788361101.329878:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:2.0:1788361101.329923:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:2.0:1788361101.332426:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:2.0:1788361101.332493:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:2.0:1788361101.332579:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:2.0:1788361101.332615:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:2.0:1788361101.332663:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144077056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361101.332758:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361101.332809:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361101.333666:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144077056 00000100:00100000:1.0:1788361101.333686:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144077056 00000100:00100000:1.0:1788361101.333739:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788361101.333749:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19251:x1875232144077056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361101.334071:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19251:x1875232144077056:12345-0@lo:502:mount.lustre.0 Request processed in 322us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361101.334113:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788361101.335119:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144077056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361101.335245:0:19251:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1788361101.335260:0:19251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788361101.336540:0:19274:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788361101.336554:0:19274:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a8ab724cd40) 00000020:00000080:2.0:1788361101.336573:0:19274:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788361101.340626:0:19274:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a8370e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788361101.340638:0:19274:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a8370e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788361101.340642:0:19274:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a8370e000 3 00010000:00080000:2.0:1788361101.340706:0:19274:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a89248800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.160@tcp at head 00010000:00010000:2.0:1788361101.342298:0:19274:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788361101.342396:0:19274:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788361101.342434:0:19274:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788361101.342451:0:19274:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf6a94c97d6611acf 00000100:00080000:2.0:1788361101.342461:0:19274:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788361101.342467:0:19274:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8a89248800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361101.342499:0:19274:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8abc896a00 x1875232144077184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361101.342558:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144077184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361101.342629:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361101.342698:0:19274:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788361101.343000:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144077184 00000100:00100000:1.0:1788361101.343007:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144077184 00000100:00100000:1.0:1788361101.343042:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361101.343049:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144077184:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788361101.343072:0:18620:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:1.0:1788361101.343134:0:18620:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf6a94c97d6611ad6 00000004:00100000:1.0:1788361101.343149:0:18620:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788361101.343180:0:18620:0:(import.c:65:import_set_state_nolock()) ffff9a8a856ea000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361101.343236:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875232144077184:12345-0@lo:38:llog_process_th.0 Request processed in 186us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361101.343243:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788361101.343269:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788361101.343273:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788361101.343276:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788361101.343279:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788361101.343430:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144077312:0@lo:400:kworker.0 00000100:00100000:1.0:1788361101.343460:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361101.343493:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144077312 00000100:00100000:1.0:1788361101.343497:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144077312 00000100:00100000:1.0:1788361101.343523:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361101.343529:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144077312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361101.343562:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144077312:12345-0@lo:400:kworker.0 Request processed in 33us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361101.343578:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788361101.343612:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8ab71b2680 x1875232144077312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361101.343626:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144077312:0@lo:400:kworker.0 00010000:00080000:2.0:1788361101.343970:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8abc896a00 x1875232144077184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361101.343980:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361101.343987:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788361101.343993:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788361101.343998:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788361101.344001:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a89248800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788361101.344006:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144077184:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788361101.344171:0:19274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:3.0:1788361101.344774:0:19251:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788361101.344803:0:19251:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361101.344825:0:19251:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611ac1 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361101.344836:0:19251:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611ac1 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788361101.344881:0:19251:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788361101.344883:0:19251:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361101.344884:0:19251:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361101.344886:0:19251:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361101.344887:0:19251:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361101.344889:0:19251:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361101.344890:0:19251:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361101.344892:0:19251:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361101.344893:0:19251:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361101.344897:0:19251:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788361101.344900:0:19251:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361101.344901:0:19251:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361101.344902:0:19251:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361101.344904:0:19251:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361101.344905:0:19251:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361101.344906:0:19251:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361101.344907:0:19251:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361101.344908:0:19251:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361101.344909:0:19251:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361101.344926:0:19251:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788361101.345015:0:19251:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144077440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361101.345064:0:19251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361101.345106:0:19251:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a848d8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361101.346733:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144077440 00000100:00100000:2.0:1788361101.346743:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144077440 00000100:00100000:2.0:1788361101.346805:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788361101.346815:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19251:x1875232144077440:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361101.346845:0:18614:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788361101.346859:0:18614:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1788361101.348185:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1788361101.373378:0:18614:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361101.373398:0:18614:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788361101.373458:0:18635:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788361101.373463:0:18635:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788361101.373485:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.373522:0:18635:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6611a4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611a43 expref: 16 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.373530:0:18635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.373573:0:18635:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6611a4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6611a43 expref: 16 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361101.373587:0:18635:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6611a4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6611a43 expref: 16 pid: 18614 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361101.373602:0:18635:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18635:1875232144077568:0@lo:104: 00000100:00100000:2.0:1788361101.373665:0:18635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361101.373752:0:18635:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361101.374788:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144077568 00000100:00100000:1.0:1788361101.374797:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144077568 00000100:00100000:1.0:1788361101.374923:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361101.374948:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+3:18635:x1875232144077568:12345-0@lo:104: 00010000:00010000:1.0:1788361101.374964:0:18603:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375048:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361101.375055:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+3:18635:x1875232144077568:12345-0@lo:104: Request processed in 121us (1390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361101.375064:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788361101.375358:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361101.375365:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375373:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361101.375377:0:18607:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375386:0:18607:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361101.375404:0:18607:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361101.375410:0:18607:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788361101.375456:0:18607:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375464:0:18607:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361101.375487:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375496:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d6611a43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a4a expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375515:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361101.375517:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361101.375519:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361101.375533:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361101.375546:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3314:1875232144077696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361101.375586:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361101.375638:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144077696 00000100:00100000:1.0:1788361101.375643:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144077696 00010000:00010000:1.0:1788361101.375662:0:18605:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6611a4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611a43 expref: 17 pid: 18614 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361101.375697:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361101.375704:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:3314:x1875232144077696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361101.375714:0:18605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361101.375728:0:18605:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6611a4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611a43 expref: 17 pid: 18614 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375741:0:18605:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6611a4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6611a43 expref: 17 pid: 18614 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375760:0:18605:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375769:0:18605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361101.375783:0:18605:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002319800s 00010000:00010000:1.0:1788361101.375788:0:18605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375795:0:18605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375803:0:18605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375809:0:18605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375814:0:18605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361101.375818:0:18605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375826:0:18605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375834:0:18605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.375916:0:18605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361101.376021:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:3314:x1875232144077696:12345-0@lo:103:ldlm_bl.0 Request processed in 316us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361101.376029:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788361101.376082:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6611a4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6611a43 expref: 16 pid: 18614 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361101.376110:0:18635:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18635:1875232144077568:0@lo:104: 00010000:00010000:1.0:1788361101.376130:0:18635:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.376138:0:18635:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.376144:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361101.376150:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6611add lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361101.376219:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3314:1875232144077696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361101.390142:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:19251:x1875232144077440:12345-0@lo:253:mount.lustre.0 Request processed in 43319us (45068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361101.390156:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788361101.390429:0:19251:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19251:1875232144077440:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361101.390448:0:19251:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788361101.390451:0:19251:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361101.390454:0:19251:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788361101.390455:0:19251:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361101.390456:0:19251:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361101.390466:0:19251:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361101.390468:0:19251:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361101.390470:0:19251:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361101.390472:0:19251:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361101.390473:0:19251:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788361101.390488:0:19251:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788361101.391063:0:19251:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361101.391237:0:19251:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361101.391458:0:19251:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361101.391618:0:19251:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361101.391791:0:19251:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361101.392078:0:19251:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788361101.393628:0:19251:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788361101.448536:0:19251:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788361101.448546:0:19251:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788361101.448580:0:19251:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788361101.448639:0:19251:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788361101.448653:0:19251:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788361101.448694:0:19251:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788361102.370260:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361102.370744:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361092/real 1788361092] req@ffff9a8986705c00 x1875232144071424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361102.370773:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8986705c00 x1875232144071424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361102 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361102.370790:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361092/real 1788361092] req@ffff9a8986707800 x1875232144071296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361102 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361102.370802:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8986707800 x1875232144071296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361102 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361102.370822:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361102.370839:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788361102.370843:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144071424:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788361102.370849:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361102.370853:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788361102.370856:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144071296:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788361102.372485:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361102.372491:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788361102.372495:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361102.372502:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:2.0:1788361102.372508:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788361102.372514:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8ac05c4800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361102.372554:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3314:1875232144077824:0@lo:400:kworker.0 00000100:00100000:1.0:1788361102.372619:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361102.372691:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144077824 00000100:00100000:1.0:1788361102.372698:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144077824 00000100:00100000:1.0:1788361102.372738:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788361102.372746:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:3314:x1875232144077824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361102.372809:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:3314:x1875232144077824:12345-0@lo:400:kworker.0 Request processed in 63us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361102.372816:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788361102.372864:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3314:1875232144077824:0@lo:400:kworker.0 00000100:00100000:2.0:1788361102.373007:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8abc894380 x1875232144077952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361102.373026:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361102.373037:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788361102.373039:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361102.373043:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:2.0:1788361102.373047:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788361102.373052:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8ac05c3000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361102.373066:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8abc894e00 x1875232144078080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361102.373142:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144077952:0@lo:8:kworker.0 00000100:00100000:2.0:1788361102.373178:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361102.373201:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144078080:0@lo:8:kworker.0 00000100:00100000:2.0:1788361102.373228:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361102.373253:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144078336:0@lo:400:kworker.0 00000100:00100000:2.0:1788361102.373279:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361102.373299:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361102.373304:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144078208:0@lo:400:kworker.0 00000100:00100000:2.0:1788361102.373345:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361102.373377:0:19253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144077952 00000100:00100000:2.0:1788361102.373382:0:19253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144077952 00000100:00100000:2.0:1788361102.373403:0:19253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144078080 00000100:00100000:2.0:1788361102.373406:0:19253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144078080 00000100:00100000:2.0:1788361102.373418:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361102.373424:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144077952:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788361102.373446:0:19253:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1788361102.373474:0:19253:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6611ae4 00002000:00100000:2.0:1788361102.373489:0:19253:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a8a8924e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788361102.373501:0:19253:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788361102.373504:0:19253:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788361102.375181:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144078336 00000100:00100000:0.0:1788361102.375205:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144078336 00000100:00100000:0.0:1788361102.375260:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144078208 00000100:00100000:0.0:1788361102.375416:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144078208 00000100:00100000:0.0:1788361102.375447:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361102.375455:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144078336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361102.375536:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144078336:12345-0@lo:400:kworker.0 Request processed in 82us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361102.375543:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361102.375560:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361102.375567:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144078208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361102.375597:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144078208:12345-0@lo:400:kworker.0 Request processed in 31us (2251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361102.375603:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788361102.375632:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788361102.375687:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8abc894700 x1875232144078208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361102.375716:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144078208:0@lo:400:kworker.0 00010000:00080000:0.0:1788361102.375735:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8abc897b80 x1875232144078336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361102.375743:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144078336:0@lo:400:kworker.0 00002000:00080000:2.0:1788361102.376585:0:19253:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788361102.376620:0:19253:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361102.376702:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144077952:12345-0@lo:8:kworker.0 Request processed in 3275us (3521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361102.376713:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361102.376740:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361102.376748:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144078080:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788361102.376764:0:19253:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788361102.377985:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144078080:12345-0@lo:8:kworker.0 Request processed in 1233us (4751us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361102.377995:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788361102.378108:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8abc894380 x1875232144077952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361102.378120:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361102.378130:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788361102.378138:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788361102.378144:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788361102.378147:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788361102.378166:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788361102.378171:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144077952:0@lo:8:kworker.0 00000100:00080000:2.0:1788361102.378183:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361102.378187:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361102.378189:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144078080:0@lo:8:kworker.0 00000004:00080000:2.0:1788361102.378225:0:18641:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788361102.378416:0:18642:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788361102.378441:0:18642:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18642:1875232144078592:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788361102.378496:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361102.378524:0:18642:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8aff8c00 going to sleep for 11 seconds 00000004:00080000:2.0:1788361102.378550:0:18641:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 492393462568ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788361102.378708:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144078464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361102.378737:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361102.378784:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144078592 00000100:00100000:1.0:1788361102.378791:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144078592 00000100:00100000:1.0:1788361102.378837:0:19254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361102.378847:0:19254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18642:x1875232144078592:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788361102.379363:0:19256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144078464 00000100:00100000:3.0:1788361102.379369:0:19256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144078464 00000100:00100000:3.0:1788361102.379437:0:19256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361102.379445:0:19256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144078464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361102.379461:0:19256:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788361102.379512:0:19256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144078464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361102.379519:0:19256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:1.0:1788361102.382499:0:19254:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788361102.382512:0:19254:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1788361102.382517:0:19254:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:65) 00000100:00080000:0.0:1788361102.383511:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788361102.392280:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab71b3800 x1875232144078464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361102.392307:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144078464:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1788361102.400031:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361102.400045:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d6611aeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.400063:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788361102.400068:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361102.400075:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d6611aeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.400236:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d6611aeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.400249:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d6611aeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.400257:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d6611aeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.400307:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361102.400317:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361102.400323:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d6611aeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.400331:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361102.400336:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d6611aeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.400347:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d6611aeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.400363:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d6611aeb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.400369:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3694924/0xf6a94c97d6611aeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.400386:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.400388:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.400390:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361102.401252:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361102.401261:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000404ed164/0xf6a94c97d6611af2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.401273:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788361102.401283:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361102.401289:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000404ed164/0xf6a94c97d6611af2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.401301:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000404ed164/0xf6a94c97d6611af2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.401310:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000404ed164/0xf6a94c97d6611af2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.401318:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000404ed164/0xf6a94c97d6611af2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.401340:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361102.401566:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361102.401574:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000404ed164/0xf6a94c97d6611af2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.401584:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361102.401589:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000404ed164/0xf6a94c97d6611af2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.401600:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000404ed164/0xf6a94c97d6611af2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.401617:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000404ed164/0xf6a94c97d6611af2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.401624:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000404ed164/0xf6a94c97d6611af2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.401641:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.401643:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.401650:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361102.401924:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361102.401931:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611af9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.401942:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788361102.401945:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361102.401950:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611af9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.401961:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611af9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.401970:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611af9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.401984:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611af9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.402000:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361102.402010:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361102.402015:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611af9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.402023:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361102.402026:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611af9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.402036:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611af9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.402048:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611af9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.402057:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611af9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.402074:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.402075:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.402077:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361102.402484:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361102.402498:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d6611b00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.402508:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788361102.402512:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361102.402517:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d6611b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.402528:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d6611b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.402537:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d6611b00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.402545:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d6611b00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.402567:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361102.402628:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361102.402634:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d6611b00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.402642:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361102.402645:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d6611b00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.402654:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d6611b00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.402675:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d6611b00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.402683:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab5f1b70/0xf6a94c97d6611b00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.402701:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.402704:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.402707:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361102.403427:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361102.403434:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d6611b07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.403445:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788361102.403448:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361102.403453:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d6611b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.403465:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d6611b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.403480:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d6611b07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.403488:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d6611b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.403512:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361102.404250:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361102.404259:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e97d46e7/0xf6a94c97d6611b0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.404272:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=492s v=(0 0) 00010000:00010000:1.0:1788361102.404277:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361102.404283:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e97d46e7/0xf6a94c97d6611b0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.404296:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e97d46e7/0xf6a94c97d6611b0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.404308:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e97d46e7/0xf6a94c97d6611b0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.404317:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e97d46e7/0xf6a94c97d6611b0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.404475:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788361102.404888:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.404895:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.404904:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.404907:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.404912:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.404922:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.404929:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.404942:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.404951:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788361102.405905:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361102.405917:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d6611b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.405929:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361102.405942:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d6611b07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.405954:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d6611b07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.405974:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d6611b07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.405982:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b3b82d0/0xf6a94c97d6611b07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.406007:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361102.406012:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e97d46e7/0xf6a94c97d6611b0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.406019:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361102.406022:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97d46e7/0xf6a94c97d6611b0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.406043:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361102.406046:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e97d46e7/0xf6a94c97d6611b0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.406059:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e97d46e7/0xf6a94c97d6611b0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.406067:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e97d46e7/0xf6a94c97d6611b0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.406104:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.406106:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.406108:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.407654:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.407664:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.407691:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361102.407696:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.407707:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.407724:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.407742:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.407756:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.407758:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.407760:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.407765:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.407767:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.409591:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.409602:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.409617:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.409621:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.409628:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.409641:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.409651:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.409659:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.409722:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361102.410786:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.410794:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.410804:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.410807:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.410812:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.410832:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.410841:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.410848:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.411098:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361102.411107:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.411116:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361102.411120:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.411142:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.411158:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b1c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.411165:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.411355:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361102.411360:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.411368:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361102.411370:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.411377:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.411388:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.411396:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.411398:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.411406:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.411691:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361102.412416:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361102.412426:0:19254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361102.413150:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.413159:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.413173:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.413178:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.413186:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.413200:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.413222:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.413230:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.413247:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361102.413258:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361102.413264:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.413272:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361102.413276:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.413286:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.413302:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.413309:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.413322:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361102.413330:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361102.413332:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.415123:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.415136:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.415151:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.415155:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.415162:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.415174:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.415185:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.415193:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.415216:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361102.415265:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361102.415273:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.415282:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361102.415287:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.415296:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.415313:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.415320:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.415335:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.415337:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.415339:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.417623:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.417636:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.417848:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.417854:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.417861:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.417884:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.417895:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.417904:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361102.417924:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788361102.417926:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361102.418138:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361102.418147:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.418158:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361102.418163:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.418173:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.418196:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.418206:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361102.418207:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361102.418209:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361102.418404:0:19254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361102.419063:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.419070:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9872fbc/0xf6a94c97d6611b3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.419080:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.419115:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.419122:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9872fbc/0xf6a94c97d6611b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.419133:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9872fbc/0xf6a94c97d6611b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.419155:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9872fbc/0xf6a94c97d6611b3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.419163:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9872fbc/0xf6a94c97d6611b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.419199:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361102.419720:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.419727:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6611b46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.419736:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.419739:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.419743:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6611b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.419754:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6611b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.419763:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6611b46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.419770:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6611b46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.419800:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788361102.419813:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361102.419821:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9872fbc/0xf6a94c97d6611b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.419843:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361102.419848:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9872fbc/0xf6a94c97d6611b3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.419857:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9872fbc/0xf6a94c97d6611b3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.419872:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9872fbc/0xf6a94c97d6611b3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.419880:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9872fbc/0xf6a94c97d6611b3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.419899:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361102.419903:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6611b46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.419910:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361102.419913:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6611b46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.419922:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6611b46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.419932:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6611b46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.419946:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6611b46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.419963:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361102.419966:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361102.419968:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.420053:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.420608:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.420615:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.420624:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.420628:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.420633:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.420643:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.420652:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.420659:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.420691:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361102.420785:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361102.420792:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.420812:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361102.420816:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.420824:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.420837:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b4d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.420846:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6611b4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.420867:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361102.420869:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361102.420872:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.421119:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.421126:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.421133:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.421142:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.421146:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.421155:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.421162:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.421169:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.421463:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361102.421596:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361102.421602:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.421611:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361102.421615:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.421624:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.421636:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.421643:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6611b54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.421658:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361102.421660:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361102.421661:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.424448:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.424464:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6611b5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.424484:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.424489:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.424496:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6611b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.424511:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6611b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.424522:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6611b5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.424538:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6611b5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.424560:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361102.424689:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361102.424699:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6611b5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.424709:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361102.424714:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6611b5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.424724:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6611b5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.424741:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6611b5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.424749:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6611b5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.424855:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.424857:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.424859:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.426893:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.426907:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.426925:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.426930:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.427779:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.428023:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.428037:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.428045:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.428081:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361102.428135:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361102.428146:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.428157:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361102.428163:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.428174:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.428197:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.428205:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d6611b62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.428229:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.428231:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.428234:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.429360:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.429368:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.429388:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.429392:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.429396:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.429408:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.429417:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.429424:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.429445:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361102.429996:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361102.430005:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.430016:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361102.430020:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.430044:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.430061:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.430071:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6611b69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.430109:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361102.430112:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361102.430114:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.430131:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.430138:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.430146:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.430150:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.430154:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.430164:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.430297:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.430304:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.430324:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361102.430616:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361102.430624:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.430645:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361102.430650:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.430659:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.430682:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.430691:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079fb94c3/0xf6a94c97d6611b70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.430710:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.430712:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.430714:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.431070:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.431077:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.431106:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.431110:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.431116:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.431127:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.431136:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.431143:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.431299:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361102.431621:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361102.431629:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.431637:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361102.431641:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.431651:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.431682:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.431689:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa506186/0xf6a94c97d6611b77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.431709:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.431711:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.431713:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.432487:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.432497:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6611b7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.432509:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.432513:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.432518:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6611b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.432528:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6611b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.432537:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6611b7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.432547:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6611b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.432576:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361102.432696:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361102.432704:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6611b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.432711:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361102.432715:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6611b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.432730:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6611b7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.432743:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6611b7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.432751:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6611b7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.432769:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.432771:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.432774:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.433986:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.433995:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6611b85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.434009:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.434019:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.434024:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6611b85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.434036:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6611b85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.434045:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6611b85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.434053:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6611b85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.434077:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361102.434129:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361102.434138:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6611b85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.434148:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361102.434153:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6611b85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.434162:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6611b85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.434178:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6611b85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.434185:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6611b85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.434215:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.434217:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.434219:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.434621:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.434627:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6611b8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.434636:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.434640:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.434644:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6611b8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.434655:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6611b8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.434663:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6611b8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.434689:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6611b8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.434712:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361102.435534:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361102.435542:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6611b8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.435553:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361102.435559:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6611b8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.435567:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6611b8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.435585:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6611b8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.435594:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6611b8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361102.435612:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.435614:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.435616:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.436550:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.436562:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa28431c/0xf6a94c97d6611b93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.436576:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.436580:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.436586:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa28431c/0xf6a94c97d6611b93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.436598:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa28431c/0xf6a94c97d6611b93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.436607:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa28431c/0xf6a94c97d6611b93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.436615:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa28431c/0xf6a94c97d6611b93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.436642:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361102.436700:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361102.436707:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa28431c/0xf6a94c97d6611b93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.436716:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361102.436720:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa28431c/0xf6a94c97d6611b93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.436729:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa28431c/0xf6a94c97d6611b93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.436744:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa28431c/0xf6a94c97d6611b93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.436765:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa28431c/0xf6a94c97d6611b93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.436783:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.436786:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.436788:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.437185:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.437192:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6611b9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437207:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.437211:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.437216:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6611b9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437226:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6611b9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437235:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6611b9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437243:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6611b9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437261:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361102.437756:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.437762:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f36c3c82/0xf6a94c97d6611ba1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437771:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.437774:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.437779:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f36c3c82/0xf6a94c97d6611ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437789:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f36c3c82/0xf6a94c97d6611ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437808:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f36c3c82/0xf6a94c97d6611ba1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437815:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f36c3c82/0xf6a94c97d6611ba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437833:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361102.437844:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361102.437849:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6611b9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437856:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361102.437860:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6611b9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437867:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6611b9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437879:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6611b9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437886:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6611b9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437900:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361102.437908:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f36c3c82/0xf6a94c97d6611ba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437915:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361102.437936:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f36c3c82/0xf6a94c97d6611ba1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437944:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f36c3c82/0xf6a94c97d6611ba1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437955:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f36c3c82/0xf6a94c97d6611ba1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437963:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f36c3c82/0xf6a94c97d6611ba1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.437979:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361102.437982:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361102.437985:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361102.438065:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.438498:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.438505:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6611ba8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.438513:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.438516:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.438521:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6611ba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.438541:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6611ba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.438549:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6611ba8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.438555:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6611ba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.438576:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361102.438723:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361102.438729:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6611ba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.438738:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361102.438742:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6611ba8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.438750:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6611ba8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.438764:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6611ba8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.438771:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6611ba8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.438790:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.438793:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.438808:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.439028:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.439040:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6611baf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439049:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.439052:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.439057:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6611baf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439067:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6611baf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439075:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6611baf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439117:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6611baf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439132:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361102.439144:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361102.439148:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6611baf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439155:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361102.439159:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6611baf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439168:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6611baf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439181:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6611baf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439189:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6611baf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439205:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361102.439207:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361102.439209:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361102.439615:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361102.439629:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d664a43/0xf6a94c97d6611bb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439637:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=492s v=(0 0) 00010000:00010000:0.0:1788361102.439641:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361102.439645:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d664a43/0xf6a94c97d6611bb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439655:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d664a43/0xf6a94c97d6611bb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.439663:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d664a43/0xf6a94c97d6611bb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.442401:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d664a43/0xf6a94c97d6611bb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.442564:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361102.442699:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361102.442708:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d664a43/0xf6a94c97d6611bb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.442718:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361102.442724:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d664a43/0xf6a94c97d6611bb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.442736:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d664a43/0xf6a94c97d6611bb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.442756:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d664a43/0xf6a94c97d6611bb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.442763:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d664a43/0xf6a94c97d6611bb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.442788:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.442790:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.442792:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361102.443573:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361102.443581:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6611bbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.443594:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1788361102.443598:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361102.443605:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6611bbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.443618:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6611bbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.443626:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6611bbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.443641:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6611bbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.443676:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361102.444251:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361102.444259:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6611bbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.444267:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361102.444271:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6611bbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.444292:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6611bbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.444306:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6611bbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.444314:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6611bbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361102.444332:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.444333:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361102.444335:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361102.444460:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361102.444466:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d6611bc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.444475:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=492s v=(0 0) 00010000:00010000:2.0:1788361102.444478:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361102.444482:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d6611bc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.444492:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d6611bc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.444500:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d6611bc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.444508:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d6611bc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361102.444564:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361102.446260:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361102.446270:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d6611bc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.446283:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361102.446287:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d6611bc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.446297:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d6611bc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.446327:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d6611bc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.446334:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d6611bc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361102.446352:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361102.446353:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361102.446355:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788361102.448463:0:19254:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1788361102.448615:0:19254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18642:x1875232144078592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 69765us (70115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361102.448633:0:19254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361102.449072:0:18642:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18642:1875232144078592:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788361102.449165:0:18642:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788361102.449322:0:18642:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18642:1875232144078720:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788361102.449358:0:18642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361102.449440:0:18642:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361102.449478:0:19253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144078720 00000100:00100000:2.0:1788361102.449485:0:19253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144078720 00000100:00100000:2.0:1788361102.449554:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361102.449563:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18642:x1875232144078720:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788361102.449606:0:19253:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00000100:00100000:2.0:1788361102.454001:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:18642:x1875232144078720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4432us (4635us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788361102.454014:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361102.454043:0:18642:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18642:1875232144078720:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788361102.454061:0:18642:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 10000000:01000000:0.0:1788361103.328789:0:18616:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788361103.328796:0:18616:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8ab6fbc800 from 10 10000000:01000000:0.0:1788361103.328801:0:18616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788361103.328846:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361103.328857:0:18616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361103.329030:0:18616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361103.329057:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144078848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361103.329212:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361103.329265:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361103.329435:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144078848 00000100:00100000:3.0:1788361103.329444:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144078848 00000100:00100000:3.0:1788361103.329507:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788361103.329517:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:18616:x1875232144078848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361103.329551:0:18614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361103.329566:0:18614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d6611bd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611bcb expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361103.329589:0:18614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d6611bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611bcb expref: 16 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361103.329600:0:18614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d6611bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611bcb expref: 16 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361103.329609:0:18614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fc00, rc 0) 00000100:00100000:3.0:1788361103.329681:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:18616:x1875232144078848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361103.329687:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788361103.330261:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144078848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361103.330277:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361103.330286:0:18616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361103.330343:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144078976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788361103.330379:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361103.330403:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361103.330418:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144078976 00000100:00100000:0.0:1788361103.330422:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144078976 00000100:00100000:0.0:1788361103.330451:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788361103.330457:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:18616:x1875232144078976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788361103.330473:0:18613:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788361103.330490:0:18613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788361103.330493:0:18613:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788361103.332716:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:18616:x1875232144078976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2251us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361103.332729:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788361103.333643:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144078976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788361103.333731:0:18616:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788361103.333742:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361103.333752:0:18616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361103.392588:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361104.417297:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361104.736558:0:18654:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788361104.736568:0:18654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361104.736609:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788361104.736617:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788361105.440233:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361106.415766:0:19620:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788361106.464307:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788361106.659215:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:3.0:1788361106.659238:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788361107.500703:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361107.627438:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144079104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361107.627515:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361107.627599:0:19257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144079104 00000100:00100000:0.0:1788361107.627607:0:19257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144079104 00000100:00100000:0.0:1788361107.627683:0:19257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361107.627692:0:19257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144079104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361107.627730:0:19257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788361107.627773:0:19257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144079104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361107.627780:0:19257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788361107.627798:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361107.627821:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788361107.627840:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144079104:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788361107.628685:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361107.628689:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788361107.628693:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361107.628698:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1788361107.628702:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361107.628708:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8ac05c3000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361107.628718:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3311:1875232144079232:0@lo:400:kworker.0 00000100:00100000:3.0:1788361107.628759:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361107.628802:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144079232 00000100:00100000:3.0:1788361107.628807:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144079232 00000100:00100000:3.0:1788361107.628836:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788361107.628843:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:3311:x1875232144079232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361107.628882:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:3311:x1875232144079232:12345-0@lo:400:kworker.0 Request processed in 39us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361107.628888:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788361107.628927:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3311:1875232144079232:0@lo:400:kworker.0 00000100:00100000:3.0:1788361107.628955:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8986706a00 x1875232144079360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361107.628986:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144079488:0@lo:400:kworker.0 00000100:00100000:3.0:1788361107.629011:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361107.629400:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144079360:0@lo:8:kworker.0 00000100:00100000:2.0:1788361107.629430:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361107.629437:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144079616:0@lo:400:kworker.0 00000100:00100000:2.0:1788361107.629458:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144079360 00000100:00100000:2.0:1788361107.629462:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144079360 00000100:00100000:3.0:1788361107.629464:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361107.629484:0:19254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361107.629489:0:19254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144079360:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788361107.629504:0:19254:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788361107.630397:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144079488 00000100:00100000:0.0:1788361107.630414:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144079488 00000100:00100000:0.0:1788361107.630454:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144079616 00000100:00100000:0.0:1788361107.630458:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144079616 00000100:00100000:0.0:1788361107.630489:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361107.630497:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144079488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361107.630554:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144079488:12345-0@lo:400:kworker.0 Request processed in 58us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361107.630561:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361107.630576:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361107.630582:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144079616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361107.630611:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144079616:12345-0@lo:400:kworker.0 Request processed in 30us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361107.630618:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788361107.630652:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788361107.631177:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8986705180 x1875232144079488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361107.631254:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144079488:0@lo:400:kworker.0 00010000:00080000:3.0:1788361107.631389:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8986704380 x1875232144079616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361107.631400:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144079616:0@lo:400:kworker.0 00000100:00100000:2.0:1788361107.644970:0:19254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144079360:12345-0@lo:8:kworker.0 Request processed in 15403us (15462us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361107.644984:0:19254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788361107.645038:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361107.645044:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361107.645049:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144079360:0@lo:8:kworker.0 00010000:00010000:0.0:1788361108.513709:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361109.537818:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361110.560441:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788361111.212805:0:19924:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788361111.212809:0:19924:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788361111.212920:0:19924:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8a9efca800 00000020:01000004:1.0:1788361111.212935:0:19924:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788361111.212948:0:19924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788361111.212976:0:19924:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a8ab7463380) 00000020:00000080:1.0:1788361111.212992:0:19924:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788361111.226813:0:19924:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788361111.227135:0:19924:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788361111.227885:0:19924:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788361111.228229:0:19924:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788361111.228495:0:19924:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:1.0:1788361111.228841:0:19924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 589: rc = 0 00100000:10000000:1.0:1788361111.228942:0:19924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 589: rc = 0 00100000:10000000:1.0:1788361111.229036:0:19924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 589: rc = 0 00100000:10000000:1.0:1788361111.229703:0:19924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 776: rc = 0 00100000:10000000:1.0:1788361111.229961:0:19924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 776: rc = 0 00100000:10000000:1.0:1788361111.230329:0:19924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 776: rc = 0 00100000:10000000:1.0:1788361111.230569:0:19924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 776: rc = 0 00100000:10000000:1.0:1788361111.230820:0:19924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 776: rc = 0 00100000:10000000:1.0:1788361111.231050:0:19924:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 776: rc = 0 00000020:00000080:1.0:1788361111.231583:0:19924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788361111.231594:0:19924:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788361111.231604:0:19924:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d6611be0 00000020:01000004:1.0:1788361111.231704:0:19924:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788361111.232037:0:19924:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788361111.232042:0:19924:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788361111.232049:0:19924:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788361111.232073:0:19924:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788361111.232076:0:19924:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788361111.240506:0:19924:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788361111.240555:0:19924:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.160@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788361111.240560:0:19924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788361111.240562:0:19924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361111.240563:0:19924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361111.240565:0:19924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361111.240566:0:19924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361111.240568:0:19924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361111.240574:0:19924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361111.240576:0:19924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361111.240577:0:19924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361111.240581:0:19924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788361111.240583:0:19924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361111.240584:0:19924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361111.240585:0:19924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361111.240586:0:19924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361111.240588:0:19924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361111.240589:0:19924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361111.240590:0:19924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361111.240591:0:19924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361111.240591:0:19924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361111.240631:0:19924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788361111.240652:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144079744:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361111.240722:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361111.240791:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361111.240882:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144079744 00000100:00100000:3.0:1788361111.240891:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144079744 00000100:00100000:3.0:1788361111.240954:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788361111.240964:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19924:x1875232144079744:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788361111.241006:0:18614:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788361111.241010:0:18614:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788361111.241015:0:18614:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788361111.250886:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19924:x1875232144079744:12345-0@lo:253:mount.lustre.0 Request processed in 9904us (10144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361111.250921:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788361111.251051:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144079744:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361111.251062:0:19924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788361111.251064:0:19924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361111.251066:0:19924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361111.251067:0:19924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361111.251067:0:19924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361111.251068:0:19924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361111.251069:0:19924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361111.251070:0:19924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361111.251071:0:19924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361111.251072:0:19924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788361111.251103:0:19924:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8a9efca800 from lustre-OST0001 10000000:01000000:0.0:1788361111.251124:0:19924:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788361111.251126:0:19924:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788361111.251133:0:19924:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8984a5b380 local copy 00010000:00010000:0.0:1788361111.251141:0:19924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611971 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361111.251321:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144079872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361111.251364:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361111.251457:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361111.251500:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144079872 00000100:00100000:3.0:1788361111.251507:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144079872 00000100:00100000:3.0:1788361111.251575:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788361111.251586:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19924:x1875232144079872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361111.251986:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19924:x1875232144079872:12345-0@lo:501:mount.lustre.0 Request processed in 402us (621us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361111.251993:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788361111.252018:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144079872:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788361111.252033:0:19924:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788361111.252184:0:19924:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788361111.252190:0:19924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611971 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361111.252207:0:19924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9a00/0xf6a94c97d661196a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611971 expref: -99 pid: 18601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361111.252225:0:19924:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8a9efca800 10000000:01000000:0.0:1788361111.252229:0:19924:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788361111.252233:0:19924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788361111.252234:0:19924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361111.252237:0:19924:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788361111.252239:0:19924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788361111.252256:0:19924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965e00/0xf6a94c97d6611be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361111.252263:0:19924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965e00/0xf6a94c97d6611be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361111.252272:0:19924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965e00/0xf6a94c97d6611be7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361111.252286:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361111.252312:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361111.252391:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361111.252464:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144080000 00000100:00100000:2.0:1788361111.252469:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144080000 00000100:00100000:2.0:1788361111.252506:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788361111.252514:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:19924:x1875232144080000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361111.252524:0:18614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361111.252536:0:18614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573f600/0xf6a94c97d6611bee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611be7 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361111.252558:0:18614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573f600/0xf6a94c97d6611bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611be7 expref: 17 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361111.252568:0:18614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573f600/0xf6a94c97d6611bee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611be7 expref: 17 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361111.252577:0:18614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:2.0:1788361111.252704:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:19924:x1875232144080000:12345-0@lo:101:mount.lustre.0 Request processed in 190us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361111.252711:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788361111.252835:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361111.252847:0:19924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965e00/0xf6a94c97d6611be7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611bee expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361111.252857:0:19924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965e00/0xf6a94c97d6611be7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611bee expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361111.253621:0:19924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788361111.255274:0:19924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361111.255526:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788361111.255573:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788361111.255621:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788361111.255674:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788361111.255711:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788361111.255760:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788361111.255813:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788361111.255852:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788361111.255919:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788361111.255974:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788361111.255982:0:19924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788361111.256125:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361111.256193:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361111.256238:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361111.256554:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144080128 00000100:00100000:3.0:1788361111.256562:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144080128 00000100:00100000:3.0:1788361111.256620:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788361111.256629:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:19924:x1875232144080128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361111.257201:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:19924:x1875232144080128:12345-0@lo:501:mount.lustre.0 Request processed in 571us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361111.257211:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788361111.258009:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361111.258067:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080256:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361111.258153:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361111.258191:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361111.258272:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144080256 00000100:00100000:2.0:1788361111.258279:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144080256 00000100:00100000:2.0:1788361111.258362:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788361111.258372:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:19924:x1875232144080256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361111.258717:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:19924:x1875232144080256:12345-0@lo:503:mount.lustre.0 Request processed in 345us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361111.258725:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361111.258807:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080256:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788361111.259488:0:19924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788361111.259558:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361111.259603:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361111.260008:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361111.260045:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144080384 00000100:00100000:1.0:1788361111.260058:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144080384 00000100:00100000:3.0:1788361111.260166:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788361111.260177:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:19924:x1875232144080384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361111.260478:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:19924:x1875232144080384:12345-0@lo:502:mount.lustre.0 Request processed in 302us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361111.260486:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788361111.260673:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080384:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361111.261053:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788361111.261189:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1788361111.261229:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1788361111.261280:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1788361111.261317:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1788361111.261354:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1788361111.261406:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1788361111.261444:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1788361111.261494:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1788361111.261535:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080512:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361111.261589:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361111.261675:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361111.261716:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144080512 00000100:00100000:1.0:1788361111.261722:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144080512 00000100:00100000:1.0:1788361111.261868:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788361111.261947:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:19924:x1875232144080512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361111.262337:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:19924:x1875232144080512:12345-0@lo:502:mount.lustre.0 Request processed in 393us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361111.262345:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788361111.262373:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361111.262465:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788361111.262476:0:19924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788361111.263970:0:19925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788361111.263978:0:19925:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788361111.263983:0:19925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361111.263985:0:19925:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788361111.263990:0:19925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361111.264001:0:19925:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a8a90bf0000) 00000020:00000080:0.0:1788361111.264020:0:19925:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788361111.264023:0:19925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788361111.264068:0:19925:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a9efca800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788361111.264078:0:19925:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788361111.264114:0:19925:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d6611bfc 00010000:00010000:0.0:1788361111.268649:0:19925:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788361111.270158:0:19925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934605 00080000:10000000:0.0:1788361111.273147:0:19925:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1788361111.277904:0:19925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788361111.277917:0:19925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361111.277925:0:19925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361111.277927:0:19925:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788361111.277930:0:19925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361111.277934:0:19925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361111.277936:0:19925:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788361111.277939:0:19925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788361111.277941:0:19925:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788361111.277943:0:19925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361111.277946:0:19925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361111.277947:0:19925:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788361111.277949:0:19925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361111.277951:0:19925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361111.277952:0:19925:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788361111.277955:0:19925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788361111.278021:0:19925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361111.278025:0:19925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361111.278026:0:19925:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788361111.278029:0:19925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788361111.278378:0:19924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788361111.278405:0:19924:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788361111.278422:0:19924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965e00/0xf6a94c97d6611be7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611bee expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361111.278434:0:19924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985965e00/0xf6a94c97d6611be7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611bee expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361111.278442:0:19924:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a9efca800 from 1 10000000:01000000:2.0:1788361111.278445:0:19924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788361111.278479:0:19924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361111.278487:0:19924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361111.278498:0:19924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361111.278523:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361111.278588:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361111.278641:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361111.279987:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144080640 00000100:00100000:3.0:1788361111.279999:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144080640 00000100:00100000:3.0:1788361111.280075:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788361111.280100:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:19924:x1875232144080640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361111.280116:0:18614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361111.280130:0:18614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6611c0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611c03 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361111.280152:0:18614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6611c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611c03 expref: 18 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361111.280161:0:18614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6611c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611c03 expref: 18 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361111.280169:0:18614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e200, rc 0) 00000100:00100000:3.0:1788361111.280245:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:19924:x1875232144080640:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361111.280252:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788361111.280355:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361111.280372:0:19924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361111.280381:0:19924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361111.280929:0:19924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1788361111.281463:0:19924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361111.281709:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788361111.281751:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788361111.281796:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788361111.281836:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788361111.281872:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788361111.281942:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788361111.281992:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788361111.282037:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788361111.282129:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788361111.282137:0:19924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1788361111.282212:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361111.282271:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361111.287793:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144080768 00000100:00100000:0.0:1788361111.287809:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144080768 00000100:00100000:0.0:1788361111.287884:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788361111.287893:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:19924:x1875232144080768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361111.288217:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:19924:x1875232144080768:12345-0@lo:501:mount.lustre.0 Request processed in 324us (5944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361111.288224:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788361111.289999:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361111.290038:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361111.291254:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361111.291328:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361111.291372:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361111.292109:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144080896 00000100:00100000:1.0:1788361111.292116:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144080896 00000100:00100000:1.0:1788361111.292156:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788361111.292163:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:19924:x1875232144080896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361111.292503:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:19924:x1875232144080896:12345-0@lo:503:mount.lustre.0 Request processed in 338us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361111.292510:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788361111.292700:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144080896:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788361111.294637:0:19924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788361111.294735:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361111.294813:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361111.294858:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361111.294889:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144081024 00000100:00100000:1.0:1788361111.294896:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144081024 00000100:00100000:1.0:1788361111.294944:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788361111.294952:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:19924:x1875232144081024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361111.295193:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:19924:x1875232144081024:12345-0@lo:502:mount.lustre.0 Request processed in 241us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361111.295201:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788361111.295409:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361111.295658:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788361111.296363:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788361111.296427:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788361111.296481:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788361111.296538:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788361111.296592:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788361111.296646:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788361111.296699:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1788361111.296737:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361111.296793:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361111.296838:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361111.297140:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144081152 00000100:00100000:3.0:1788361111.297147:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144081152 00000100:00100000:3.0:1788361111.297189:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788361111.297198:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:19924:x1875232144081152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361111.297388:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:19924:x1875232144081152:12345-0@lo:502:mount.lustre.0 Request processed in 190us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361111.297395:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788361111.297438:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361111.297539:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788361111.297549:0:19924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788361111.298554:0:19929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361111.298564:0:19929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361111.298566:0:19929:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788361111.298573:0:19929:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a9efca800 00000020:00000080:0.0:1788361111.298575:0:19929:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361111.298582:0:19929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361111.298584:0:19929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361111.298586:0:19929:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788361111.298588:0:19929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361111.298590:0:19929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361111.298591:0:19929:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788361111.298594:0:19929:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a9efca800 00000020:00000080:0.0:1788361111.298596:0:19929:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361111.298659:0:19929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361111.298663:0:19929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361111.298664:0:19929:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788361111.298667:0:19929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361111.298669:0:19929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361111.298670:0:19929:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788361111.298681:0:19929:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8a9efca800 00000020:00000080:0.0:1788361111.298683:0:19929:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361111.298721:0:19929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361111.298724:0:19929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361111.298726:0:19929:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788361111.298729:0:19929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1788361111.303226:0:19924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788361111.303269:0:19924:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361111.303330:0:19924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.303343:0:19924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361111.303392:0:19924:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788361111.303402:0:19924:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8a9efca800 10000000:01000000:1.0:1788361111.303404:0:19924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8a9efca800 10000000:01000000:1.0:1788361111.303408:0:19924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361111.303413:0:19924:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a9efca800 from 1 10000000:01000000:1.0:1788361111.303416:0:19924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361111.303450:0:19924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9200/0xf6a94c97d6611c11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.303459:0:19924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9200/0xf6a94c97d6611c11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.303469:0:19924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9200/0xf6a94c97d6611c11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361111.303492:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361111.303558:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361111.303597:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83190480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361111.303715:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144081280 00000100:00100000:1.0:1788361111.303723:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144081280 00000100:00100000:1.0:1788361111.303831:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788361111.303841:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:19924:x1875232144081280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361111.303857:0:18612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361111.303868:0:18612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611c18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611c11 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.303952:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611c11 expref: 19 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.303964:0:18612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ac06c9a00/0xf6a94c97d6611c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611c11 expref: 19 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.303985:0:18612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac06c9a00, rc 0) 00000100:00100000:1.0:1788361111.304025:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1462450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:19924:x1875232144081280:12345-0@lo:101:mount.lustre.0 Request processed in 185us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361111.304032:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788361111.304079:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361111.304116:0:19924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9200/0xf6a94c97d6611c11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611c18 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.304126:0:19924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9200/0xf6a94c97d6611c11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611c18 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361111.305847:0:19924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:1.0:1788361111.306438:0:19924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361111.306733:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788361111.307995:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1788361111.308038:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1788361111.308195:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1788361111.308237:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1788361111.308284:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1788361111.308319:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1788361111.308351:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1788361111.308398:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788361111.308432:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1788361111.308464:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1788361111.308512:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1788361111.308548:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1788361111.308579:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1788361111.308636:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1788361111.308694:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1788361111.308731:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1788361111.309626:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1788361111.309672:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1788361111.309704:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1788361111.310065:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1788361111.310142:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1788361111.310176:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1788361111.310222:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1788361111.310255:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:1.0:1788361111.310286:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:1.0:1788361111.310334:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:1.0:1788361111.310372:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:1.0:1788361111.310406:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:1.0:1788361111.310452:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:1.0:1788361111.310487:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:1.0:1788361111.310543:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:1.0:1788361111.310578:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:1.0:1788361111.310640:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:1.0:1788361111.310679:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:1.0:1788361111.310729:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:1.0:1788361111.310844:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:1.0:1788361111.310962:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:1.0:1788361111.311030:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:1.0:1788361111.311070:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:1.0:1788361111.311192:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:1.0:1788361111.311200:0:19924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:1.0:1788361111.311307:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361111.311376:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361111.311429:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83190480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361111.311552:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144081408 00000100:00100000:2.0:1788361111.311560:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144081408 00000100:00100000:2.0:1788361111.311622:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788361111.311632:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:19924:x1875232144081408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361111.311855:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:19924:x1875232144081408:12345-0@lo:501:mount.lustre.0 Request processed in 225us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361111.311864:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788361111.312052:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361111.312122:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361111.312160:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361111.312193:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83190480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361111.313956:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144081536 00000100:00100000:2.0:1788361111.313968:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144081536 00000100:00100000:2.0:1788361111.314027:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788361111.314037:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:19924:x1875232144081536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361111.314411:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:19924:x1875232144081536:12345-0@lo:503:mount.lustre.0 Request processed in 375us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361111.314427:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788361111.316238:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788361111.319153:0:19924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361111.319240:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361111.319310:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361111.319400:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361111.322055:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144081664 00000100:00100000:2.0:1788361111.322069:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144081664 00000100:00100000:2.0:1788361111.322712:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788361111.322724:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:19924:x1875232144081664:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361111.323306:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:19924:x1875232144081664:12345-0@lo:502:mount.lustre.0 Request processed in 583us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361111.323315:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788361111.323940:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361111.324335:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788361111.324394:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788361111.324431:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788361111.324500:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788361111.324540:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788361111.324587:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788361111.324640:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788361111.324671:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788361111.324719:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788361111.324844:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788361111.324964:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788361111.325016:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788361111.325051:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788361111.325190:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788361111.325249:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788361111.325284:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788361111.325318:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788361111.325365:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788361111.325401:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788361111.325459:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788361111.325511:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788361111.325547:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788361111.325578:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788361111.325668:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788361111.325706:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:1.0:1788361111.325738:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:1.0:1788361111.325798:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:1.0:1788361111.325836:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:1.0:1788361111.325878:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:1.0:1788361111.325930:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:1.0:1788361111.325968:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:1.0:1788361111.326002:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:1.0:1788361111.326036:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:1.0:1788361111.326111:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:1.0:1788361111.326151:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:1.0:1788361111.326221:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:1.0:1788361111.326257:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:1.0:1788361111.326287:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:1.0:1788361111.326331:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:1.0:1788361111.326365:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:1.0:1788361111.326412:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361111.326486:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361111.326533:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361111.326775:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144081792 00000100:00100000:3.0:1788361111.326783:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144081792 00000100:00100000:3.0:1788361111.326834:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788361111.326843:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:19924:x1875232144081792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361111.327107:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:19924:x1875232144081792:12345-0@lo:502:mount.lustre.0 Request processed in 263us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361111.327122:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788361111.327140:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144081792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361111.327212:0:19924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:0.0:1788361111.327227:0:19924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788361111.336420:0:19934:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788361111.336438:0:19934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a8a90bf4d40) 00000020:00000080:0.0:1788361111.336461:0:19934:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788361111.336628:0:19934:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a9efca800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788361111.336633:0:19934:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a9efca800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788361111.336636:0:19934:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a9efca800 3 00010000:00080000:0.0:1788361111.336680:0:19934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a89850eb000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361111.345151:0:19934:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788361111.345260:0:19934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788361111.345300:0:19934:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788361111.345312:0:19934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf6a94c97d6611c26 00000100:00080000:3.0:1788361111.345323:0:19934:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361111.345330:0:19934:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a89850eb000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361111.345363:0:19934:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8986704380 x1875232144081920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361111.345391:0:19934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788361111.345410:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144081920:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361111.345490:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361111.345571:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144081920 00000100:00100000:2.0:1788361111.345577:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144081920 00000100:00100000:2.0:1788361111.345622:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361111.345629:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144081920:12345-0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788361111.345652:0:19934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00010000:00080000:2.0:1788361111.345652:0:18621:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:2.0:1788361111.346342:0:18621:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf6a94c97d6611c2d 00000004:00100000:2.0:1788361111.346359:0:18621:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788361111.346391:0:18621:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361111.346442:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875232144081920:12345-0@lo:38:llog_process_th.0 Request processed in 813us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361111.346450:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788361111.346501:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8986704380 x1875232144081920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361111.346511:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361111.346518:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788361111.346535:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788361111.346539:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788361111.346541:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89850eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788361111.346547:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144081920:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788361111.346909:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788361111.346914:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788361111.346917:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361111.346921:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 497 00000100:00080000:1.0:1788361111.346926:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788361111.346930:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8ac05c3000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361111.346953:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ab71b3480 x1875232144082176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361111.347021:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144082048:0@lo:400:kworker.0 00000100:00100000:1.0:1788361111.347065:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361111.347124:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144082048 00000100:00100000:1.0:1788361111.347129:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144082048 00000100:00100000:1.0:1788361111.347167:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361111.347174:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144082048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361111.347215:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144082048:12345-0@lo:400:kworker.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361111.347222:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788361111.347237:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361111.347257:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144082048:0@lo:400:kworker.0 00000020:01000000:1.0:1788361111.347280:0:19924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788361111.347307:0:19924:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788361111.347326:0:19924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9200/0xf6a94c97d6611c11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611c18 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.347336:0:19924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9200/0xf6a94c97d6611c11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611c18 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361111.347347:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144082176:0@lo:8:kworker.0 00000100:00100000:2.0:1788361111.347379:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788361111.347382:0:19924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788361111.347385:0:19924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788361111.347387:0:19924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361111.347388:0:19924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361111.347390:0:19924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361111.347392:0:19924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361111.347394:0:19924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361111.347396:0:19924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361111.347398:0:19924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788361111.347406:0:19924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788361111.347408:0:19924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361111.347410:0:19924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000100:00100000:2.0:1788361111.347412:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144082176 00000020:01000004:1.0:1788361111.347412:0:19924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361111.347414:0:19924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361111.347417:0:19924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:2.0:1788361111.347419:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144082176 00000020:01000004:1.0:1788361111.347419:0:19924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361111.347421:0:19924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361111.347423:0:19924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361111.347424:0:19924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788361111.347438:0:19924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788361111.347447:0:19254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361111.347451:0:19924:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144082560:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788361111.347457:0:19254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144082176:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788361111.347492:0:19924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361111.347514:0:19924:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361111.347521:0:19254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144082176:12345-0@lo:8:kworker.0 Request processed in 62us (139us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788361111.347529:0:19254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361111.347552:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144082560 00000100:00100000:2.0:1788361111.347555:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144082560 00000100:00100000:2.0:1788361111.347586:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788361111.347593:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:19924:x1875232144082560:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361111.347621:0:18613:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788361111.347635:0:18613:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788361111.348072:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361111.348079:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361111.348164:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788361111.348170:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144082176:0@lo:8:kworker.0 00000100:00100000:3.0:1788361111.348280:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144082304:0@lo:400:kworker.0 00000100:00100000:3.0:1788361111.348317:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361111.348341:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361111.348348:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144082432:0@lo:400:kworker.0 00000100:00100000:3.0:1788361111.348370:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361111.348574:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144082304 00000100:00100000:3.0:1788361111.348579:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144082304 00000100:00100000:3.0:1788361111.348616:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144082432 00000100:00100000:3.0:1788361111.348620:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144082432 00000100:00100000:3.0:1788361111.348649:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361111.348656:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144082304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361111.348697:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144082304:12345-0@lo:400:kworker.0 Request processed in 41us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361111.348704:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361111.348719:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361111.348732:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144082432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361111.350102:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144082432:12345-0@lo:400:kworker.0 Request processed in 1348us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361111.350112:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788361111.351836:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788361111.351953:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab71b3b80 x1875232144082432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361111.351971:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144082432:0@lo:400:kworker.0 00010000:00080000:3.0:1788361111.351990:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ab71b3100 x1875232144082304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361111.352078:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144082304:0@lo:400:kworker.0 20000000:01000000:2.0:1788361111.388868:0:18613:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788361111.388893:0:18613:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788361111.388919:0:18635:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361111.388925:0:18635:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361111.388948:0:18635:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.388969:0:18635:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d6611bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611bcb expref: 19 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.388978:0:18635:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.389025:0:18635:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d6611bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6611bcb expref: 19 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.389040:0:18635:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d6611bd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6611bcb expref: 19 pid: 18614 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361111.389054:0:18635:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18635:1875232144082688:0@lo:104: 00000100:00100000:1.0:1788361111.389155:0:18635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361111.389221:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144082688 00000100:00100000:1.0:1788361111.389228:0:18635:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361111.389230:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144082688 00000100:00100000:0.0:1788361111.389291:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361111.389300:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+3:18635:x1875232144082688:12345-0@lo:104: 00010000:00010000:0.0:1788361111.389314:0:18603:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361111.389380:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361111.389388:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+3:18635:x1875232144082688:12345-0@lo:104: Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361111.389395:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361111.389409:0:18635:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18635:1875232144082688:0@lo:104: 00010000:00010000:0.0:1788361111.389420:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361111.389427:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.389430:0:18635:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361111.389450:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361111.389454:0:18607:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361111.389463:0:18607:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361111.389470:0:18607:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361111.389475:0:18607:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361111.389511:0:18607:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361111.389518:0:18607:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361111.389539:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361111.389547:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d6611bcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611bd2 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361111.389565:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361111.389568:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361111.389571:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361111.389584:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3313:1875232144082816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361111.389633:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361111.392240:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144082816 00000100:00100000:1.0:1788361111.392261:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144082816 00010000:00010000:1.0:1788361111.392300:0:18605:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d6611bd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611bcb expref: 20 pid: 18614 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361111.392336:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361111.392345:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+20:3313:x1875232144082816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361111.392360:0:18605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361111.392366:0:18605:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d6611bd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611bcb expref: 20 pid: 18614 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.392378:0:18605:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d6611bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6611bcb expref: 20 pid: 18614 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.392406:0:18605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d6611bd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6611bcb expref: 20 pid: 18614 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.392421:0:18605:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.392433:0:18605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788361111.392448:0:18605:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003523142s 00010000:00010000:1.0:1788361111.392453:0:18605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.392475:0:18605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.392482:0:18605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.392489:0:18605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.392495:0:18605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361111.392500:0:18605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.392508:0:18605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.392536:0:18605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361111.392547:0:18605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361111.392617:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3313:x1875232144082816:12345-0@lo:103:ldlm_bl.0 Request processed in 262us (2971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361111.392625:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788361111.392652:0:18635:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361111.392663:0:18635:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361111.392669:0:18635:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ac06c8600/0xf6a94c97d6611c34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18635 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361111.392832:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3313:1875232144082816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361111.401621:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:19924:x1875232144082560:12345-0@lo:253:mount.lustre.0 Request processed in 54009us (54111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361111.401655:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788361111.401724:0:19924:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:19924:1875232144082560:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788361111.401739:0:19924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788361111.401742:0:19924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788361111.401744:0:19924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788361111.401745:0:19924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361111.401746:0:19924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361111.401747:0:19924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361111.401755:0:19924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361111.401756:0:19924:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361111.401758:0:19924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361111.401759:0:19924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788361111.401773:0:19924:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788361111.403393:0:19924:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361111.403641:0:19924:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788361111.403801:0:19924:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361111.403966:0:19924:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788361111.404643:0:19924:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361111.404862:0:19924:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788361111.409693:0:19924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788361111.463234:0:19924:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788361111.463241:0:19924:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788361111.463281:0:19924:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788361111.463338:0:19924:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788361111.463355:0:19924:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788361111.463379:0:19924:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788361111.585266:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361112.608343:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361112.739114:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361112.739144:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144082944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361112.739236:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361112.739347:0:19257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144082944 00000100:00100000:1.0:1788361112.739356:0:19257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144082944 00000100:00100000:1.0:1788361112.739413:0:19257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361112.739423:0:19257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144082944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361112.739527:0:19257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788361112.739586:0:19257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144082944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361112.739594:0:19257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361112.739655:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144082944:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1788361113.376232:0:18616:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361113.376243:0:18616:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8ab6fbc800 from 11 10000000:01000000:3.0:1788361113.376251:0:18616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361113.376308:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d6611c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361113.376329:0:18616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d6611c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361113.376343:0:18616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d6611c3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361113.376379:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144083072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361113.376468:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361113.376545:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a880ca240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361113.376696:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144083072 00000100:00100000:1.0:1788361113.376707:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144083072 00000100:00100000:1.0:1788361113.376771:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788361113.376783:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:18616:x1875232144083072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361113.376802:0:18612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361113.376987:0:18612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ac06c9400/0xf6a94c97d6611c42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611c3b expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361113.377023:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ac06c9400/0xf6a94c97d6611c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611c3b expref: 19 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361113.377144:0:18612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ac06c9400/0xf6a94c97d6611c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611c3b expref: 19 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361113.377157:0:18612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac06c9400, rc 0) 00000100:00100000:1.0:1788361113.377359:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:18616:x1875232144083072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 576us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361113.377369:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788361113.378121:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144083072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361113.378144:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d6611c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611c42 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361113.378154:0:18616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d6611c3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611c42 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361113.378227:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144083200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788361113.378275:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361113.378310:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a880ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361113.379222:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144083200 00000100:00100000:2.0:1788361113.379240:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144083200 00000100:00100000:2.0:1788361113.379296:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788361113.379306:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:18616:x1875232144083200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788361113.379336:0:18613:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788361113.379360:0:18613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788361113.379363:0:18613:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788361113.382666:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:18616:x1875232144083200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 3350us (4377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361113.382686:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788361113.382751:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144083200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788361113.382855:0:18616:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788361113.382869:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d6611c3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611c42 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361113.382881:0:18616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fe00/0xf6a94c97d6611c3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611c42 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361113.632937:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361114.656318:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361114.977801:0:18654:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788361114.977811:0:18654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361114.978721:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:3.0:1788361114.978798:0:18654:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361114.978831:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1788361115.686814:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361116.035438:0:20280:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788361116.704405:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361116.832297:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361116.832302:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788361116.832306:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361116.832318:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8ac05c3000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361116.832340:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8abc896300 x1875232144083584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361116.832397:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144083456:0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.832468:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361116.832521:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788361116.832527:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3312:1875232144083328:0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.832555:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361116.832588:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144083968:0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.832626:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361116.832655:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144083584:0@lo:8:kworker.0 00000100:00100000:2.0:1788361116.832678:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361116.832713:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144083840:0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.832736:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361116.832754:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361116.832758:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144083712:0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.832778:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361116.832802:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144083456 00000100:00100000:2.0:1788361116.832809:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144083456 00000100:00100000:2.0:1788361116.832853:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144083584 00000100:00100000:2.0:1788361116.832856:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144083584 00000100:00100000:2.0:1788361116.832869:0:19254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361116.832877:0:19254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144083456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.832930:0:19254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144083456:12345-0@lo:400:kworker.0 Request processed in 54us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361116.832936:0:19254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361116.832951:0:19254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361116.832955:0:19254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144083584:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788361116.832976:0:19254:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1788361116.833001:0:19254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6611c49 00002000:00100000:2.0:1788361116.833020:0:19254:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a8a83e4a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788361116.833025:0:19254:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788361116.833028:0:19254:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788361116.833389:0:19254:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788361116.833410:0:19254:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361116.833450:0:19254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144083584:12345-0@lo:8:kworker.0 Request processed in 493us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361116.833457:0:19254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361116.833477:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144083968 00000100:00100000:2.0:1788361116.833481:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144083968 00000100:00100000:2.0:1788361116.833506:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144083840 00000100:00100000:2.0:1788361116.833509:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144083840 00000100:00100000:2.0:1788361116.833521:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144083712 00000100:00100000:2.0:1788361116.833523:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144083712 00000100:00100000:2.0:1788361116.833536:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361116.833542:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144083968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.833582:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144083968:12345-0@lo:400:kworker.0 Request processed in 40us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361116.833588:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361116.833600:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361116.833605:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144083840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.833637:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144083840:12345-0@lo:400:kworker.0 Request processed in 32us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361116.833642:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361116.833652:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788361116.833658:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144083712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.833682:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144083712:12345-0@lo:400:kworker.0 Request processed in 25us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361116.833695:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788361116.833721:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361116.833725:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788361116.833785:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc896300 x1875232144083584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361116.833800:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788361116.833807:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788361116.833811:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788361116.833814:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788361116.833825:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788361116.833830:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144083584:0@lo:8:kworker.0 00000004:00080000:2.0:1788361116.833868:0:18644:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:2.0:1788361116.833883:0:18644:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18644:1875232144084224:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788361116.833908:0:18644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361116.833923:0:18644:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed09c0 going to sleep for 11 seconds 00010000:00080000:2.0:1788361116.833944:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc897b80 x1875232144083712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361116.833953:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144083712:0@lo:400:kworker.0 00010000:00080000:2.0:1788361116.833962:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc894700 x1875232144083840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361116.833970:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144083840:0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.833989:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144084096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361116.834013:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788361116.834040:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8abc894a80 x1875232144083968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361116.834057:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144083968:0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.834072:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144083456:0@lo:400:kworker.0 00000100:00100000:2.0:1788361116.834116:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144084224 00000100:00100000:2.0:1788361116.834120:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144084224 00000100:00100000:2.0:1788361116.834155:0:19254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361116.834163:0:19254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:18644:x1875232144084224:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788361116.835840:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144083328 00000100:00100000:1.0:1788361116.835849:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144083328 00000100:00100000:1.0:1788361116.835895:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788361116.835905:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3312:x1875232144083328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361116.835978:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3312:x1875232144083328:12345-0@lo:400:kworker.0 Request processed in 75us (3420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361116.835986:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000004:00080000:1.0:1788361116.836046:0:18643:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788361116.836314:0:18643:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 506851226805ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788361116.836334:0:19257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144084096 00000100:00100000:1.0:1788361116.836339:0:19257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144084096 00000100:00100000:1.0:1788361116.836367:0:19257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361116.836375:0:19257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144084096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361116.836399:0:19257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361116.836438:0:19257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144084096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361116.836445:0:19257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788361116.837006:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a834c8e00 x1875232144084096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361116.837035:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144084096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361116.837050:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3312:1875232144083328:0@lo:400:kworker.0 00000100:00080000:2.0:1788361116.843216:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788361116.852751:0:19254:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788361116.852761:0:19254:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1788361116.852767:0:19254:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00010000:2.0:1788361116.868983:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361116.868999:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d6611c50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.869017:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1788361116.869022:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361116.869028:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d6611c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.869044:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d6611c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.869055:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d6611c50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.869074:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d6611c50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.870668:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.870726:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.870734:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d6611c50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.870746:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.870751:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d6611c50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.870761:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d6611c50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.870780:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d6611c50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.870788:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac421c52/0xf6a94c97d6611c50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.870807:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.870809:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.870811:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.882041:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.882055:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.882072:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.882076:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.882100:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.882116:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.882127:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.882135:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.882154:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361116.882189:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361116.882198:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.882208:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361116.882213:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.882224:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.882244:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.882253:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.882278:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.882286:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.882289:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.884499:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.884510:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611c5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.884536:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.884540:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.884546:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.884559:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.884580:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611c5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.884588:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611c5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.884613:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.884852:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.884865:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611c5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.884875:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.884880:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611c5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.884891:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611c5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.884908:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611c5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.884916:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611c5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.884934:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.884936:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.884938:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788361116.893834:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1788361116.894075:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.894102:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005da48f29/0xf6a94c97d6611c65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.894118:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.894123:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.894129:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005da48f29/0xf6a94c97d6611c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.894142:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005da48f29/0xf6a94c97d6611c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.895061:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005da48f29/0xf6a94c97d6611c65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.895070:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005da48f29/0xf6a94c97d6611c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.895272:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361116.895832:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.895840:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038b18de5/0xf6a94c97d6611c6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.895851:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.895855:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.895860:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038b18de5/0xf6a94c97d6611c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.895872:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038b18de5/0xf6a94c97d6611c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.895881:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038b18de5/0xf6a94c97d6611c6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.895888:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038b18de5/0xf6a94c97d6611c6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.895951:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361116.895959:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005da48f29/0xf6a94c97d6611c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.895967:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361116.895972:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005da48f29/0xf6a94c97d6611c65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.895981:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005da48f29/0xf6a94c97d6611c65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.895998:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005da48f29/0xf6a94c97d6611c65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.896005:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005da48f29/0xf6a94c97d6611c65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.896022:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361116.896025:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038b18de5/0xf6a94c97d6611c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.896032:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361116.896035:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038b18de5/0xf6a94c97d6611c6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.896054:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038b18de5/0xf6a94c97d6611c6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.896064:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038b18de5/0xf6a94c97d6611c6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.896072:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.896074:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.896076:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.896527:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361116.896533:0:19254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038b18de5/0xf6a94c97d6611c6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361116.897012:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.897019:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3694924/0xf6a94c97d6611c73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.897029:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.897032:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.897037:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3694924/0xf6a94c97d6611c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.897047:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3694924/0xf6a94c97d6611c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.897055:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3694924/0xf6a94c97d6611c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.897063:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3694924/0xf6a94c97d6611c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.897364:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361116.897371:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3694924/0xf6a94c97d6611c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.897379:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361116.897383:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3694924/0xf6a94c97d6611c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.897451:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3694924/0xf6a94c97d6611c73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.897464:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3694924/0xf6a94c97d6611c73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.897472:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.897474:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.897476:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.897578:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361116.897583:0:19254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3694924/0xf6a94c97d6611c73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361116.898033:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.898039:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611c7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.898048:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.898052:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.898057:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.898067:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.898075:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611c7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.898082:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611c7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.898258:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361116.898264:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611c7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.898272:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361116.898276:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611c7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.898283:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611c7a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.898294:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611c7a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.898303:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.898304:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.898306:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.898373:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361116.898379:0:19254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047d0c4b9/0xf6a94c97d6611c7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361116.898800:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.898805:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b3b82d0/0xf6a94c97d6611c81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.898823:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.898827:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.898830:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b3b82d0/0xf6a94c97d6611c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.898840:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b3b82d0/0xf6a94c97d6611c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.898848:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b3b82d0/0xf6a94c97d6611c81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.898854:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b3b82d0/0xf6a94c97d6611c81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.899119:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361116.899134:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b3b82d0/0xf6a94c97d6611c81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.899142:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361116.899145:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b3b82d0/0xf6a94c97d6611c81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.899162:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b3b82d0/0xf6a94c97d6611c81 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.899185:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b3b82d0/0xf6a94c97d6611c81 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.899194:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.899195:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.899198:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.899373:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361116.899379:0:19254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b3b82d0/0xf6a94c97d6611c81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361116.899855:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.899861:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97d46e7/0xf6a94c97d6611c88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.899871:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.899875:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.899880:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e97d46e7/0xf6a94c97d6611c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.899901:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e97d46e7/0xf6a94c97d6611c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.899911:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97d46e7/0xf6a94c97d6611c88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.899918:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e97d46e7/0xf6a94c97d6611c88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.900009:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361116.900016:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e97d46e7/0xf6a94c97d6611c88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.900023:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361116.900027:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97d46e7/0xf6a94c97d6611c88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.900035:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97d46e7/0xf6a94c97d6611c88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.900047:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e97d46e7/0xf6a94c97d6611c88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.900055:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.900057:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.900059:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.900306:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361116.900311:0:19254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e97d46e7/0xf6a94c97d6611c88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361116.900767:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.900774:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.900784:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.900787:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.900792:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.900802:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.900819:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.900826:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.901050:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361116.901056:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.901075:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361116.901079:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.901103:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.901117:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c8f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.901232:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.901234:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.901236:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.901305:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361116.901311:0:19254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000023b3c86/0xf6a94c97d6611c8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361116.901751:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.901758:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d6611c96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.901767:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.901770:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.901776:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d6611c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.901785:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d6611c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.901794:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d6611c96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.901810:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d6611c96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.901943:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361116.901949:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d6611c96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.901957:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361116.901961:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d6611c96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.901969:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d6611c96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.901981:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d6611c96 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.901994:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.901997:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.901999:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788361116.903659:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788361116.903731:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361116.903741:0:19254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab8de60a/0xf6a94c97d6611c96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361116.905135:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.905145:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdeeac4/0xf6a94c97d6611c9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.905258:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.905263:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.905268:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fdeeac4/0xf6a94c97d6611c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.905281:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fdeeac4/0xf6a94c97d6611c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.905291:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fdeeac4/0xf6a94c97d6611c9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.905298:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fdeeac4/0xf6a94c97d6611c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.905324:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361116.905740:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.905746:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611ca4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.905755:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.905758:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.905762:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.905770:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.905778:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611ca4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.905785:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.905798:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361116.906278:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361116.906286:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fdeeac4/0xf6a94c97d6611c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906295:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361116.906304:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdeeac4/0xf6a94c97d6611c9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906314:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fdeeac4/0xf6a94c97d6611c9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906331:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fdeeac4/0xf6a94c97d6611c9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906338:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fdeeac4/0xf6a94c97d6611c9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906356:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361116.906360:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906366:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c9e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361116.906369:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611ca4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906377:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611ca4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906441:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611ca4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906449:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000147a25c6/0xf6a94c97d6611ca4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906470:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.906472:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.906473:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.906480:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.906653:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.906659:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6611cab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906667:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.906670:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.906675:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6611cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906685:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6611cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906693:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6611cab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906700:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6611cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.906709:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361116.907103:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.907109:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d6611cb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907127:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.907130:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.907134:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d6611cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907143:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d6611cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907150:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d6611cb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907291:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d6611cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907307:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361116.907317:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361116.907321:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6611cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907328:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcaa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361116.907332:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6611cab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907339:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6611cab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907360:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6611cab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907368:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6611cab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907381:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361116.907384:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d6611cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907665:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361116.907669:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d6611cb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907677:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d6611cb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907689:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d6611cb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907695:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d6611cb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.907708:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.907710:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.907717:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.908561:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.908579:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.908621:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.908629:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6611cb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.908641:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.908645:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.908649:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6611cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.908659:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6611cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.908667:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6611cb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.908675:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6611cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.908702:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.908748:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.908756:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6611cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.908765:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcba00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.908769:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6611cb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.908789:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6611cb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.908805:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6611cb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.908814:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6611cb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.908832:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.908835:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.908837:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.909073:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.909079:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6611cc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.909104:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.909108:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.909112:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6611cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.909133:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6611cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.909142:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6611cc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.909148:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6611cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.909291:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.909603:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.909610:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6611cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.909619:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.909623:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6611cc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.909631:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6611cc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.909646:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6611cc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.909678:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6611cc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.909697:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.909700:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.909701:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.909707:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.909715:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6611cc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.909724:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.909727:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.909731:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6611cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.909740:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6611cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.909747:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6611cc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.909765:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6611cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.909786:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.909834:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.909840:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6611cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.909848:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.909851:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6611cc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.909859:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6611cc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.909870:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6611cc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.909877:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6611cc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.909891:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.909893:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.909895:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.910326:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.910332:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6611cce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.910341:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.910344:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.910348:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6611cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.910357:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6611cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.910365:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6611cce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.910372:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6611cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.910386:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.910415:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.910421:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6611cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.910430:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.910434:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6611cce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.910443:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6611cce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.910456:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6611cce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.910463:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6611cce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.910480:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.910482:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.910484:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.910766:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.910772:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d6611cd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.910785:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.910787:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.910792:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d6611cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.910800:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d6611cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.910808:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d6611cd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.910815:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d6611cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.911010:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.911127:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.911133:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d6611cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.911141:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcae00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.911145:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d6611cd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.911165:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d6611cd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.911178:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d6611cd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.911185:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d6611cd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.911200:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.911201:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.911204:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.911544:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.911551:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6611cdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.911560:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.911563:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.911578:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6611cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.911588:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6611cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.911609:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6611cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.911616:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6611cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.911636:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.911681:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.911688:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6611cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.911697:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.911701:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6611cdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.911709:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6611cdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.911721:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6611cdc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.911741:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6611cdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.911760:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.911762:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.911765:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.912351:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.912357:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d6611ce3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.912366:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.912370:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.912375:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d6611ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.912384:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d6611ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.912483:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d6611ce3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.912491:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d6611ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.912520:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.912598:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.912605:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d6611ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.912615:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.912619:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d6611ce3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.912627:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d6611ce3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.912639:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d6611ce3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.912647:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d6611ce3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.912674:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.912676:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.912679:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.913234:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.913240:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6611cea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.913250:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.913253:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.913257:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6611cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.913520:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6611cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.913531:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6611cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.913540:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6611cea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.913561:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.913602:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.913610:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6611cea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.913618:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.913623:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6611cea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.913631:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6611cea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.913645:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6611cea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.913662:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6611cea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.913681:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.913683:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.913685:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.914049:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.914055:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d6611cf1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.914063:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.914071:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.914076:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d6611cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.914271:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d6611cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.914281:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d6611cf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.914289:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d6611cf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.914305:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.914321:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.914329:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d6611cf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.914337:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.914341:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d6611cf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.914363:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d6611cf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.914378:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d6611cf1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.914385:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d6611cf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.914400:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.914402:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.914403:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.914753:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.914759:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6611cf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.914767:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.914770:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.914774:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6611cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.914784:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6611cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.914792:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6611cf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.914805:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6611cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.914825:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.915131:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.915137:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6611cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.915147:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.915151:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6611cf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.915159:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6611cf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.915170:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6611cf8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.915188:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6611cf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.915382:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.915386:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.915388:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.915463:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.915469:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d6611cff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.915477:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.915481:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.915485:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d6611cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.915494:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d6611cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.915502:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d6611cff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.915508:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d6611cff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.915589:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.915596:0:18608:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.915602:0:18608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d6611cff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.915611:0:18608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.915614:0:18608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d6611cff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.915623:0:18608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d6611cff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.915635:0:18608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d6611cff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.915643:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d6611cff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.915805:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.915808:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.915810:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.916051:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.916057:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6611d06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.916070:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.916073:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.916077:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6611d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.916150:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6611d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.916222:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6611d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.916230:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6611d06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.916249:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.916602:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.916610:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6611d06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.916619:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.916623:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6611d06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.916633:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6611d06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361116.916646:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361116.916647:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6611d06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.916655:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d6611d0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.916663:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.916666:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.916670:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d6611d0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.916680:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d6611d0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.916699:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d6611d0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.916706:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d6611d0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.916760:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.916777:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6611d06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.916797:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.916801:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d6611d0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.916807:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.916811:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d6611d0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.916820:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d6611d0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.916843:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d6611d0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.916850:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d6611d0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.916868:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.916870:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361116.917271:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361116.917276:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d6611d14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.917285:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=506s v=(0 0) 00010000:00010000:1.0:1788361116.917288:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361116.917292:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d6611d14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.917300:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d6611d14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.917308:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d6611d14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361116.917314:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d6611d14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.917444:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361116.917451:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d6611d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.917459:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361116.917462:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d6611d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.917470:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d6611d14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.917481:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d6611d14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.917489:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.917491:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.917493:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361116.919858:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361116.919872:0:19254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d6611d14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.921768:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361116.923455:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361116.924063:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361116.924072:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2b3d20c/0xf6a94c97d6611d1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.924134:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788361116.924139:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361116.924145:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2b3d20c/0xf6a94c97d6611d1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.924159:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2b3d20c/0xf6a94c97d6611d1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.924169:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2b3d20c/0xf6a94c97d6611d1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.924176:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2b3d20c/0xf6a94c97d6611d1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.924202:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361116.924225:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.924241:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2b3d20c/0xf6a94c97d6611d1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.924250:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361116.924255:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2b3d20c/0xf6a94c97d6611d1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.924272:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2b3d20c/0xf6a94c97d6611d1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.924292:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2b3d20c/0xf6a94c97d6611d1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.924301:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2b3d20c/0xf6a94c97d6611d1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.924342:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.924345:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.924347:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361116.924623:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361116.924630:0:19254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e40149/0xf6a94c97d6611d22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.924638:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=506s v=(0 0) 00010000:00010000:0.0:1788361116.924641:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361116.924646:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070e40149/0xf6a94c97d6611d22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.924655:0:19254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070e40149/0xf6a94c97d6611d22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.924675:0:19254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070e40149/0xf6a94c97d6611d22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.924682:0:19254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070e40149/0xf6a94c97d6611d22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361116.924703:0:19254:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788361116.924881:0:19254:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:0.0:1788361116.924975:0:19254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:18644:x1875232144084224:12345-0@lo:5:osp-pre-1-0.0 Request processed in 90810us (91062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361116.924987:0:19254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361116.925126:0:18644:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18644:1875232144084224:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788361116.925140:0:18644:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:1.0:1788361116.925183:0:18644:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18644:1875232144084352:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788361116.925221:0:18644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361116.925267:0:18644:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa0acdf00 going to sleep for 11 seconds 00010000:00010000:2.0:1788361116.925270:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361116.925278:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070e40149/0xf6a94c97d6611d22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.925287:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964e00 already unused, calling callback (ffffffffc1589400) 00000100:00100000:1.0:1788361116.925287:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144084352 00010000:00010000:2.0:1788361116.925293:0:19344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e40149/0xf6a94c97d6611d22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361116.925295:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144084352 00010000:00010000:2.0:1788361116.925306:0:19344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070e40149/0xf6a94c97d6611d22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.925321:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070e40149/0xf6a94c97d6611d22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361116.925329:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070e40149/0xf6a94c97d6611d22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361116.925337:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361116.925349:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:18644:x1875232144084352:12345-0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1788361116.925351:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.925354:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361116.925358:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788361116.925387:0:19255:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1788361116.931018:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18644:x1875232144084352:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5663us (5787us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788361116.931032:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361116.931222:0:18644:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18644:1875232144084352:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788361116.931239:0:18644:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1788361117.691206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361117.691307:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130465792 00000100:00100000:0.0:1788361117.691317:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130465792 00000100:00100000:0.0:1788361117.691365:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1788361117.691373:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1875232130465792:12345-192.168.203.60@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788361117.691400:0:18613:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d@192.168.203.60@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:0.0:1788361117.691429:0:18613:0:(genops.c:1406:class_connect()) connect: client 2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d, cookie 0xf6a94c97d6611d29 00000100:00080000:0.0:1788361117.691571:0:18613:0:(import.c:65:import_set_state_nolock()) ffff9a89850e8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361117.691648:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+5:2348:x1875232130465792:12345-192.168.203.60@tcp:250:mount.lustre.0 Request processed in 274us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361117.691663:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:3.0:1788361117.693867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361117.693985:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130465920 00000100:00100000:1.0:1788361117.693994:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130465920 00000100:00100000:1.0:1788361117.694050:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:1.0:1788361117.694059:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+5:16635:x1875232130465920:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788361117.694074:0:18612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361117.694135:0:18612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bca000/0xf6a94c97d6611d30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e73f expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.694174:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bca000/0xf6a94c97d6611d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e73f expref: 6 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.694186:0:18612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bca000/0xf6a94c97d6611d30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e73f expref: 6 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.694196:0:18612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca000, rc 0) 00000100:00100000:1.0:1788361117.694241:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+6:16635:x1875232130465920:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 183us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361117.694248:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1788361117.695975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361117.696056:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130466048 00000100:00100000:1.0:1788361117.696063:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130466048 00000100:00100000:1.0:1788361117.696145:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:1.0:1788361117.696154:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+6:16635:x1875232130466048:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788361117.696512:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+6:16635:x1875232130466048:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 358us (543us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361117.696519:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:2.0:1788361117.706244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361117.708967:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130466176 00000100:00100000:0.0:1788361117.708982:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130466176 00000100:00100000:0.0:1788361117.709289:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:0.0:1788361117.709300:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+6:16635:x1875232130466176:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361117.709332:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361117.709353:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964600/0xf6a94c97d6611d37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e746 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361117.709383:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964600/0xf6a94c97d6611d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e746 expref: 7 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361117.709394:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964600/0xf6a94c97d6611d37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e746 expref: 7 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361117.709403:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964600, rc 0) 00000100:00100000:0.0:1788361117.709480:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+7:16635:x1875232130466176:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 182us (3245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361117.709488:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:3.0:1788361117.711058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361117.711215:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130466304 00000100:00100000:1.0:1788361117.711224:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130466304 00000100:00100000:1.0:1788361117.711262:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:1.0:1788361117.711283:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+7:16635:x1875232130466304:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788361117.711578:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+8:16635:x1875232130466304:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 297us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361117.711585:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:3.0:1788361117.713156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361117.713238:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130466432 00000100:00100000:1.0:1788361117.713257:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130466432 00000100:00100000:1.0:1788361117.713303:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:1.0:1788361117.713312:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+8:16635:x1875232130466432:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788361117.713514:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+8:16635:x1875232130466432:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 203us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361117.713522:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:3.0:1788361117.718194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361117.718290:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130466560 00000100:00100000:0.0:1788361117.718299:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130466560 00000100:00100000:0.0:1788361117.718351:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1788361117.718359:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+8:16654:x1875232130466560:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361117.718634:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+8:16654:x1875232130466560:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 276us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361117.718641:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00010000:00010000:0.0:1788361117.728319:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361117.733203:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361117.733308:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130466688 00000100:00100000:2.0:1788361117.733319:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130466688 00000100:00100000:2.0:1788361117.733378:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1788361117.733389:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+8:16654:x1875232130466688:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361117.733685:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+8:16654:x1875232130466688:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 297us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361117.733693:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:3.0:1788361117.742027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361117.742309:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130466816 00000100:00100000:2.0:1788361117.742319:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130466816 00000100:00100000:2.0:1788361117.742377:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1788361117.742387:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+8:16635:x1875232130466816:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788361117.742403:0:18614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361117.742421:0:18614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611d3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e770 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361117.742450:0:18614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e770 expref: 9 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361117.742461:0:18614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611d3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e770 expref: 9 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361117.742471:0:18614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:2.0:1788361117.742534:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+9:16635:x1875232130466816:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 148us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361117.742556:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:3.0:1788361117.747050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361117.747213:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130466944 00000100:00100000:0.0:1788361117.747223:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130466944 00000100:00100000:0.0:1788361117.747280:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:0.0:1788361117.747290:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+9:16635:x1875232130466944:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788361117.747316:0:18613:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788361117.747344:0:18613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788361117.747349:0:18613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788361117.747353:0:18613:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788361117.747355:0:18613:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1788361117.748992:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1569450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+9:16635:x1875232130466944:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 1696us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361117.749004:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1788361117.754018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361117.754185:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130467072 00000100:00100000:1.0:1788361117.754196:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130467072 00000100:00100000:1.0:1788361117.754367:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:1.0:1788361117.754378:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+9:16635:x1875232130467072:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788361117.754396:0:18612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361117.754414:0:18612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611d45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e777 expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.754441:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e777 expref: 10 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.754452:0:18612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e777 expref: 10 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.754460:0:18612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca800, rc 0) 00000100:00100000:1.0:1788361117.754522:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:16635:x1875232130467072:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 145us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361117.754529:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1788361117.757194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361117.757479:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130467200 00000100:00100000:0.0:1788361117.757489:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130467200 00000100:00100000:0.0:1788361117.757850:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:0.0:1788361117.757862:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:16635:x1875232130467200:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788361117.758257:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1569050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:16635:x1875232130467200:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 396us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361117.758266:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:3.0:1788361117.759976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361117.760225:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130467328 00000100:00100000:1.0:1788361117.760235:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130467328 00000100:00100000:1.0:1788361117.760300:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:1.0:1788361117.760310:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:16635:x1875232130467328:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788361117.760583:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:16635:x1875232130467328:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 274us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361117.760592:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:3.0:1788361117.766578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361117.766846:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130467456 00000100:00100000:0.0:1788361117.766857:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130467456 00000100:00100000:0.0:1788361117.766911:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:0.0:1788361117.766920:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:16660:x1875232130467456:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361117.767389:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1568850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:16660:x1875232130467456:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 464us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361117.767397:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1788361117.772214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361117.774252:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130467584 00000100:00100000:2.0:1788361117.774267:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130467584 00000100:00100000:2.0:1788361117.774401:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:2.0:1788361117.774413:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:16660:x1875232130467584:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361117.774679:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:16660:x1875232130467584:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 267us (2478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361117.774687:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:3.0:1788361117.777501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361117.777743:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130467712 00000100:00100000:2.0:1788361117.777753:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130467712 00000100:00100000:2.0:1788361117.777801:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361117.777808:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2348:x1875232130467712:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788361117.777836:0:18652:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 6dc24666-75f2-466e-bd74-ac2809e63d73@192.168.203.60@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:2.0:1788361117.780053:0:18652:0:(genops.c:1406:class_connect()) connect: client 6dc24666-75f2-466e-bd74-ac2809e63d73, cookie 0xf6a94c97d6611d4c 00000004:00100000:2.0:1788361117.780203:0:18652:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788361117.780214:0:18652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:2.0:1788361117.814453:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361117.814590:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2348:x1875232130467712:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 36779us (37095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361117.814601:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361117.821741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361117.822528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361117.823280:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130467968 00000100:00100000:0.0:1788361117.823289:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130467968 00000100:00100000:1.0:1788361117.823428:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130467840 00000100:00100000:1.0:1788361117.823433:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130467840 00000100:00100000:1.0:1788361117.823458:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788361117.823467:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+7:16635:x1875232130467968:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788361117.823508:0:18620:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788361117.823593:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+7:16635:x1875232130467968:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 126us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361117.823602:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788361117.823620:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361117.823626:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+6:0:x1875232130467840:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788361117.823637:0:18620:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788361117.823660:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+6:0:x1875232130467840:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 34us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361117.823666:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00080000:3.0:1788361117.823725:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361117.825604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361117.825693:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130468096 00000100:00100000:1.0:1788361117.825700:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130468096 00000100:00100000:1.0:1788361117.825786:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361117.825795:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+6:16635:x1875232130468096:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788361117.825873:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+6:16635:x1875232130468096:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361117.825880:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788361117.828170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361117.828210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361117.828248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361117.828289:0:19253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130468224 00000100:00100000:3.0:1788361117.828298:0:19253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130468224 00000100:00100000:3.0:1788361117.828337:0:19253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130468352 00000100:00100000:3.0:1788361117.828341:0:19253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130468352 00000100:00100000:3.0:1788361117.828359:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361117.828368:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875232130468224:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361117.828398:0:19253:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 6dc24666-75f2-466e-bd74-ac2809e63d73@192.168.203.60@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:3.0:1788361117.828428:0:19253:0:(genops.c:1406:class_connect()) connect: client 6dc24666-75f2-466e-bd74-ac2809e63d73, cookie 0xf6a94c97d6611d53 00002000:00100000:3.0:1788361117.828439:0:19253:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6dc24666-75f2-466e-bd74-ac2809e63d73/ffff9a898694a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361117.828472:0:19253:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361117.828806:0:19253:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788361117.828847:0:19253:0:(import.c:65:import_set_state_nolock()) ffff9a898694e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361117.828913:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2348:x1875232130468224:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 546us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361117.828922:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361117.828939:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361117.828944:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875232130468352:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361117.828959:0:19253:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 6dc24666-75f2-466e-bd74-ac2809e63d73@192.168.203.60@tcp t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:3.0:1788361117.828995:0:19253:0:(genops.c:1406:class_connect()) connect: client 6dc24666-75f2-466e-bd74-ac2809e63d73, cookie 0xf6a94c97d6611d5a 00002000:00100000:3.0:1788361117.829002:0:19253:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6dc24666-75f2-466e-bd74-ac2809e63d73/ffff9a8986949800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361117.829009:0:19253:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788361117.829135:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130468480 00000100:00100000:1.0:1788361117.829150:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130468480 00002000:00080000:3.0:1788361117.829194:0:19253:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1788361117.829195:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361117.829209:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+6:16635:x1875232130468480:12345-192.168.203.60@tcp:33:mount.lustre.0 00000100:00080000:3.0:1788361117.829219:0:19253:0:(import.c:65:import_set_state_nolock()) ffff9a898694b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361117.829255:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2348:x1875232130468352:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 309us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361117.829265:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000004:00080000:0.0:1788361117.832268:0:18622:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3003us 00000004:00200000:0.0:1788361117.850607:0:18622:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788361117.850810:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+6:16635:x1875232130468480:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 21591us (22633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361117.850833:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788361117.856803:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144084480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361117.856876:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361117.857016:0:19257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144084480 00000100:00100000:1.0:1788361117.857024:0:19257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144084480 00000100:00100000:1.0:1788361117.857143:0:19257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361117.857154:0:19257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144084480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361117.857178:0:19257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788361117.857234:0:19257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144084480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361117.857241:0:19257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361117.857311:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144084480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361117.990898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361117.990997:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130468608 00000100:00100000:1.0:1788361117.991008:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130468608 00000100:00100000:1.0:1788361117.991075:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361117.991110:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+6:16681:x1875232130468608:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:1.0:1788361117.991130:0:18620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361117.991153:0:18620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6611d61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e7a1 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.991217:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6611d68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.991231:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6611d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.991244:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6611d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361117.991750:0:18620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788361117.991755:0:18620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361117.991848:0:18620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6611d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.991874:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6611d61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7a1 expref: 8 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.991890:0:18620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6611d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7a1 expref: 7 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361117.991898:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:1.0:1788361117.991901:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361117.991904:0:18620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb400, rc 0) 00000100:00100000:1.0:1788361117.991967:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+7:16681:x1875232130468608:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 884us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361117.991974:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:2.0:1788361118.752267:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361119.776257:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361119.789284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361119.789356:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130468736 00000100:00100000:2.0:1788361119.789367:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130468736 00000100:00100000:2.0:1788361119.789455:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361119.789467:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+7:16733:x1875232130468736:12345-192.168.203.60@tcp:41:lfs.0 00000004:00000024:2.0:1788361119.789513:0:18652:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1788361119.789540:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361119.789909:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+7:16733:x1875232130468736:12345-192.168.203.60@tcp:41:lfs.0 Request processed in 443us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361119.789918:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361119.800784:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361119.800943:0:19256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130468864 00000100:00100000:1.0:1788361119.800954:0:19256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130468864 00000100:00080000:3.0:1788361119.801016:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361119.801037:0:19256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788361119.801048:0:19256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6dc24666-75f2-466e-bd74-ac2809e63d73+6:16733:x1875232130468864:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:1.0:1788361119.801116:0:19256:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788361119.801201:0:19256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6dc24666-75f2-466e-bd74-ac2809e63d73+6:16733:x1875232130468864:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 154us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361119.801208:0:19256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361119.802974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361119.803075:0:19257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130468992 00000100:00100000:2.0:1788361119.803108:0:19257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130468992 00000100:00100000:2.0:1788361119.803177:0:19257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788361119.803188:0:19257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6dc24666-75f2-466e-bd74-ac2809e63d73+6:16733:x1875232130468992:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:2.0:1788361119.803225:0:19257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361119.803308:0:19257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6dc24666-75f2-466e-bd74-ac2809e63d73+6:16733:x1875232130468992:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 121us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361119.803315:0:19257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00080000:3.0:1788361119.803427:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361119.985872:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361119.985982:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130469120 00000100:00100000:0.0:1788361119.985993:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130469120 00000100:00100000:0.0:1788361119.986055:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:0.0:1788361119.986065:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:16768:x1875232130469120:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361119.986083:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361119.986135:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964800/0xf6a94c97d6611d6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e7a8 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361119.986160:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964800/0xf6a94c97d6611d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7a8 expref: 11 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361119.986171:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964800/0xf6a94c97d6611d6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7a8 expref: 11 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361119.986180:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964800, rc 0) 00000100:00100000:0.0:1788361119.986246:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:16768:x1875232130469120:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 182us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361119.986253:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:0.0:1788361119.992146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361119.992318:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130469248 00000100:00100000:2.0:1788361119.992328:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130469248 00000100:00100000:2.0:1788361119.992385:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:2.0:1788361119.992395:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:16768:x1875232130469248:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788361119.992725:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1568450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:16768:x1875232130469248:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 330us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361119.992734:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:3.0:1788361120.003599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361120.003689:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130469376 00000100:00100000:0.0:1788361120.003699:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130469376 00000100:00100000:0.0:1788361120.003753:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:0.0:1788361120.003762:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:16768:x1875232130469376:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788361120.004000:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:16768:x1875232130469376:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 238us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361120.004017:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:3.0:1788361120.006655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361120.008164:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130469504 00000100:00100000:1.0:1788361120.008178:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130469504 00000100:00100000:1.0:1788361120.008234:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:1.0:1788361120.008243:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:16772:x1875232130469504:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361120.008722:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1569c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:16772:x1875232130469504:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 478us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361120.008730:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:1.0:1788361120.023996:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361120.029662:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130469632 00000100:00100000:2.0:1788361120.029694:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130469632 00000100:00100000:2.0:1788361120.029760:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:2.0:1788361120.029771:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:16772:x1875232130469632:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361120.030797:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:16772:x1875232130469632:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 284us (6067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361120.030809:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:3.0:1788361120.037692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361120.038229:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130469760 00000100:00100000:0.0:1788361120.038240:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130469760 00000100:00100000:0.0:1788361120.038454:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:0.0:1788361120.038464:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:16768:x1875232130469760:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361120.038479:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361120.038496:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965c00/0xf6a94c97d6611d76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e7d2 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361120.038525:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965c00/0xf6a94c97d6611d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d2 expref: 12 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361120.038535:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965c00/0xf6a94c97d6611d76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d2 expref: 12 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361120.038544:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965c00, rc 0) 00000100:00100000:0.0:1788361120.038622:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:16768:x1875232130469760:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 159us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361120.038628:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:3.0:1788361120.043719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361120.043844:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130469888 00000100:00100000:2.0:1788361120.043856:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130469888 00000100:00100000:2.0:1788361120.043913:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:2.0:1788361120.043924:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:16768:x1875232130469888:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788361120.043950:0:18614:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788361120.043974:0:18614:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788361120.043978:0:18614:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788361120.043987:0:18614:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788361120.043990:0:18614:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1788361120.046599:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1569850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:16768:x1875232130469888:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 2666us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361120.046614:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:3.0:1788361120.049869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361120.050074:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130470016 00000100:00100000:0.0:1788361120.050297:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130470016 00000100:00100000:1.0:1788361120.050424:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:1.0:1788361120.050439:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:16768:x1875232130470016:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788361120.050457:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361120.050474:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611d7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e7d9 expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361120.050504:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611d7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d9 expref: 13 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361120.050516:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611d7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d9 expref: 13 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361120.050524:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb600, rc 0) 00000100:00100000:1.0:1788361120.050681:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1568050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16768:x1875232130470016:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 247us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361120.050688:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:3.0:1788361120.052689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361120.053083:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130470144 00000100:00100000:2.0:1788361120.053138:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130470144 00000100:00100000:2.0:1788361120.053242:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:2.0:1788361120.053252:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac156bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16768:x1875232130470144:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788361120.053571:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac156bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16768:x1875232130470144:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 320us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361120.053579:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:0.0:1788361120.057678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361120.058411:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130470272 00000100:00100000:2.0:1788361120.058439:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130470272 00000100:00100000:2.0:1788361120.058505:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:2.0:1788361120.058516:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16768:x1875232130470272:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788361120.058789:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1577450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16768:x1875232130470272:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 274us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361120.058799:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:3.0:1788361120.062231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361120.062327:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130470400 00000100:00100000:2.0:1788361120.062337:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130470400 00000100:00100000:2.0:1788361120.062402:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:2.0:1788361120.062412:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16777:x1875232130470400:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361120.062673:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16777:x1875232130470400:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 261us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361120.062682:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:3.0:1788361120.066501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361120.066603:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130470528 00000100:00100000:1.0:1788361120.066612:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130470528 00000100:00100000:1.0:1788361120.066727:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:1.0:1788361120.066750:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16777:x1875232130470528:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361120.067001:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16777:x1875232130470528:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 251us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361120.067009:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:0.0:1788361120.079427:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361120.079634:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130470656 00000100:00100000:2.0:1788361120.079644:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130470656 00000100:00100000:2.0:1788361120.079881:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1788361120.079890:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1875232130470656:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788361120.079919:0:18621:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 2329b358-e201-4b49-9217-354f420c399f@192.168.203.60@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:2.0:1788361120.079956:0:18621:0:(genops.c:1406:class_connect()) connect: client 2329b358-e201-4b49-9217-354f420c399f, cookie 0xf6a94c97d6611d84 00000004:00100000:2.0:1788361120.079986:0:18621:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788361120.080149:0:18621:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361120.080436:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+6:2348:x1875232130470656:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 545us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361120.080446:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361120.085756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361120.085793:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361120.085879:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130470912 00000100:00100000:0.0:1788361120.085889:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130470912 00000100:00100000:0.0:1788361120.085942:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130470784 00000100:00100000:0.0:1788361120.085945:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130470784 00000100:00100000:0.0:1788361120.085973:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361120.085995:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+7:16768:x1875232130470912:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788361120.086037:0:18621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788361120.086129:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+7:16768:x1875232130470912:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 135us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361120.086137:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361120.086154:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361120.086160:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+6:0:x1875232130470784:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788361120.086170:0:18621:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788361120.086189:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+6:0:x1875232130470784:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361120.086194:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00080000:3.0:1788361120.086471:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361120.092511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361120.092791:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130471040 00000100:00100000:0.0:1788361120.092801:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130471040 00000100:00100000:0.0:1788361120.095174:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:0.0:1788361120.095193:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+6:16768:x1875232130471040:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788361120.095303:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+6:16768:x1875232130471040:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 117us (2800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361120.095311:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361120.098734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361120.098793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361120.098826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361120.098878:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130471424 00000100:00100000:2.0:1788361120.098888:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130471424 00000100:00100000:2.0:1788361120.098937:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:2.0:1788361120.098946:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2329b358-e201-4b49-9217-354f420c399f+6:16768:x1875232130471424:12345-192.168.203.60@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788361120.099227:0:18623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1788361120.099556:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2329b358-e201-4b49-9217-354f420c399f+6:16768:x1875232130471424:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 601us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361120.099564:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361120.099908:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130471168 00000100:00100000:3.0:1788361120.099915:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130471168 00000100:00100000:3.0:1788361120.099948:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130471296 00000100:00100000:3.0:1788361120.099951:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130471296 00000100:00100000:3.0:1788361120.099964:0:19254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361120.099970:0:19254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875232130471168:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361120.099993:0:19254:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 2329b358-e201-4b49-9217-354f420c399f@192.168.203.60@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:3.0:1788361120.100020:0:19254:0:(genops.c:1406:class_connect()) connect: client 2329b358-e201-4b49-9217-354f420c399f, cookie 0xf6a94c97d6611d8b 00002000:00100000:3.0:1788361120.100031:0:19254:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2329b358-e201-4b49-9217-354f420c399f/ffff9a898694f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361120.100042:0:19254:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361120.101290:0:19254:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788361120.101325:0:19254:0:(import.c:65:import_set_state_nolock()) ffff9a898694d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361120.102165:0:19254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2329b358-e201-4b49-9217-354f420c399f+6:2348:x1875232130471168:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 2189us (3436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361120.102176:0:19254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361120.102202:0:19254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361120.102209:0:19254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875232130471296:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361120.102249:0:19254:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 2329b358-e201-4b49-9217-354f420c399f@192.168.203.60@tcp t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:3.0:1788361120.102272:0:19254:0:(genops.c:1406:class_connect()) connect: client 2329b358-e201-4b49-9217-354f420c399f, cookie 0xf6a94c97d6611d92 00002000:00100000:3.0:1788361120.102282:0:19254:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2329b358-e201-4b49-9217-354f420c399f/ffff9a898694c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361120.102292:0:19254:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361120.102361:0:19254:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788361120.102381:0:19254:0:(import.c:65:import_set_state_nolock()) ffff9a898694b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361120.102414:0:19254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2329b358-e201-4b49-9217-354f420c399f+6:2348:x1875232130471296:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 204us (3621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361120.102421:0:19254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788361120.229696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361120.229803:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130471552 00000100:00100000:0.0:1788361120.229813:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130471552 00000100:00100000:0.0:1788361120.229880:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788361120.229891:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2329b358-e201-4b49-9217-354f420c399f+6:16798:x1875232130471552:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:0.0:1788361120.229915:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361120.229937:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611d99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e803 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361120.230410:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361120.230425:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361120.230439:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361120.230707:0:18652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361120.230712:0:18652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361120.230796:0:18652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361120.230827:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611d99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e803 expref: 8 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361120.230845:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e803 expref: 7 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361120.230855:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:0.0:1788361120.230858:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361120.230862:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965800, rc 0) 00000100:00100000:0.0:1788361120.230987:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2329b358-e201-4b49-9217-354f420c399f+7:16798:x1875232130471552:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 1098us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361120.231008:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:2.0:1788361120.804204:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361121.824426:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361121.952349:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144084992:0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.952425:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361121.952489:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788361121.952496:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3313:1875232144084608:0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.952525:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361121.952559:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144085120:0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.952580:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361121.952607:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144084736:0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.952631:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361121.952648:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144085248:0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.952666:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361121.952688:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361121.952694:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144084864:0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.952729:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361121.952771:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144084992 00000100:00100000:2.0:1788361121.952778:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144084992 00000100:00100000:2.0:1788361121.952832:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144085120 00000100:00100000:2.0:1788361121.952836:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144085120 00000100:00100000:2.0:1788361121.952855:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144085248 00000100:00100000:2.0:1788361121.952858:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144085248 00000100:00100000:2.0:1788361121.952872:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788361121.952879:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144084992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.952926:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144084992:12345-0@lo:400:kworker.0 Request processed in 46us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361121.952933:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788361121.952949:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788361121.952954:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144085120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.952978:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144085120:12345-0@lo:400:kworker.0 Request processed in 24us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361121.952983:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788361121.952994:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361121.952999:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144085248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.953025:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144085248:12345-0@lo:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361121.953031:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361121.953048:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144084608 00000100:00100000:2.0:1788361121.953051:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144084608 00000100:00100000:2.0:1788361121.953073:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788361121.953079:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3313:x1875232144084608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.953125:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1577c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3313:x1875232144084608:12345-0@lo:400:kworker.0 Request processed in 45us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361121.953136:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788361121.953166:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144084736 00000100:00100000:2.0:1788361121.953169:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144084736 00000100:00100000:2.0:1788361121.953192:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144084864 00000100:00100000:2.0:1788361121.953195:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144084864 00000100:00100000:2.0:1788361121.953207:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361121.953212:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144084736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.953240:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144084736:12345-0@lo:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361121.953246:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361121.953257:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361121.953262:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144084864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.953287:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144084864:12345-0@lo:400:kworker.0 Request processed in 25us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361121.953292:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788361121.953354:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361121.953358:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361121.953360:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361121.953375:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144085376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361121.953409:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361121.953435:0:19257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144085376 00000100:00100000:2.0:1788361121.953438:0:19257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144085376 00000100:00100000:2.0:1788361121.953458:0:19257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361121.953464:0:19257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144085376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361121.953486:0:19257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361121.953518:0:19257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144085376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361121.953528:0:19257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361121.953581:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144085376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361121.953610:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144084864:0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.953619:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144084736:0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.953627:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144085248:0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.953648:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3313:1875232144084608:0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.953659:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144085120:0@lo:400:kworker.0 00000100:00100000:2.0:1788361121.953669:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144084992:0@lo:400:kworker.0 00000001:00100000:0.0:1788361122.026665:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2329b358-e201-4b49-9217-354f420c399f 00000001:00100000:0.0:1788361122.026679:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6dc24666-75f2-466e-bd74-ac2809e63d73 00000001:00080000:3.0:1788361122.075284:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788361122.075357:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2329b358-e201-4b49-9217-354f420c399f 00000001:00100000:3.0:1788361122.075364:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6dc24666-75f2-466e-bd74-ac2809e63d73 00000001:02000400:2.0:1788361122.438428:0:20485:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788361122.848864:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361122.977314:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144085504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361122.977412:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361122.977523:0:19257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144085504 00000100:00100000:1.0:1788361122.977549:0:19257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144085504 00000100:00100000:0.0:1788361122.977917:0:19257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361122.977940:0:19257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144085504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361122.978739:0:19257:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788361122.978828:0:19257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144085504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 896us (1414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361122.978837:0:19257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361122.978936:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144085504:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788361123.023368:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2329b358-e201-4b49-9217-354f420c399f 00000001:00100000:3.0:1788361123.023383:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6dc24666-75f2-466e-bd74-ac2809e63d73 00010000:00010000:2.0:1788361123.872376:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361124.193865:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788361124.900241:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361125.034287:0:20634:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe4a6217c0 20000000:00000080:2.0:1788361125.034306:0:20634:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8986726400 uarg=0000000000000000 20000000:01000000:2.0:1788361125.034340:0:20634:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788361125.034345:0:20634:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788361125.034350:0:20634:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788361125.035510:0:20635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788361125.035666:0:20634:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788361125.042715:0:20634:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788361125.042746:0:20634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.042765:0:20634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d6611a66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611a5f expref: 18 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.042791:0:20634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d6611ab3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611aac expref: 18 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.042798:0:20634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6611c0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611c03 expref: 18 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.042808:0:20634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611d45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e777 expref: 12 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.042816:0:20634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611d7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d9 expref: 12 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.042823:0:20634:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.042864:0:20634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611d7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d9 expref: 12 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.042880:0:20634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611d7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d9 expref: 12 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361125.042894:0:20634:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20634:1875232144085632:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361125.043004:0:20634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e777 expref: 12 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.043013:0:20634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e777 expref: 12 pid: 18612 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361125.043021:0:20634:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20634:1875232144085760:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361125.043055:0:20634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6611c0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6611c03 expref: 18 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.043063:0:20634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6611c0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6611c03 expref: 18 pid: 18614 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361125.043073:0:20634:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20634:1875232144085888:0@lo:104: 00000100:00100000:2.0:1788361125.043132:0:20634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361125.043163:0:20634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d6611ab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6611aac expref: 18 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.043171:0:20634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d6611ab3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6611aac expref: 18 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361125.043179:0:20634:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20634:1875232144086016:0@lo:104: 00000100:00100000:2.0:1788361125.043200:0:20634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361125.043217:0:20634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d6611a66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6611a5f expref: 18 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.043224:0:20634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d6611a66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6611a5f expref: 18 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361125.043232:0:20634:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20634:1875232144086144:0@lo:104: 00000100:00100000:2.0:1788361125.043254:0:20634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361125.043263:0:20634:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361125.043485:0:18603:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788361125.043499:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144085888 00000100:00100000:0.0:1788361125.043506:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144085888 00000100:00100000:0.0:1788361125.043552:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144086016 00000100:00100000:0.0:1788361125.043555:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144086016 00000100:00100000:0.0:1788361125.043571:0:18603:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144086144 00000100:00100000:0.0:1788361125.043574:0:18603:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144086144 00000100:00100000:0.0:1788361125.043590:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361125.043598:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+5:20634:x1875232144085888:12345-0@lo:104: 00010000:00010000:0.0:1788361125.043612:0:18603:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.043661:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361125.043668:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+5:20634:x1875232144085888:12345-0@lo:104: Request processed in 70us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361125.043675:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361125.043691:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361125.043698:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+4:20634:x1875232144086016:12345-0@lo:104: 00010000:00010000:0.0:1788361125.043706:0:18603:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.043762:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788361125.043768:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+4:20634:x1875232144086016:12345-0@lo:104: Request processed in 71us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361125.043774:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361125.043795:0:18603:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361125.043801:0:18603:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a848cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+3:20634:x1875232144086144:12345-0@lo:104: 00010000:00010000:0.0:1788361125.043808:0:18603:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.043841:0:18603:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788361125.043847:0:18603:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a848cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+3:20634:x1875232144086144:12345-0@lo:104: Request processed in 47us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361125.043852:0:18603:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788361125.043888:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788361125.043894:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.043901:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361125.043905:0:19344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.043913:0:19344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361125.043921:0:19344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361125.043927:0:19344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361125.043959:0:19344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.043966:0:19344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361125.043997:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044004:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611c03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611c0a expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044015:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361125.044019:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044024:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1ba5c20) 00000100:00100000:3.0:1788361125.044026:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3314:1875232144086272:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1788361125.044026:0:19344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044033:0:19344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361125.044039:0:19344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361125.044044:0:19344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788361125.044056:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788361125.044061:0:19344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044066:0:19344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361125.044080:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044116:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6611aac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611ab3 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361125.044119:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144086272 00000100:00100000:3.0:1788361125.044123:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144086272 00010000:00010000:0.0:1788361125.044125:0:19344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361125.044128:0:19344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044134:0:19344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e400 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361125.044137:0:19344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.044138:0:18606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6611c0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611c03 expref: 19 pid: 18614 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044144:0:19344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361125.044150:0:19344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361125.044155:0:19344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788361125.044157:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788361125.044167:0:19344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044172:0:19344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361125.044178:0:19344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044185:0:19344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e400/0xf6a94c97d6611a5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6611a66 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044196:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361125.044203:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361125.044205:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361125.044212:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361125.044218:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361125.044231:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3311:1875232144086400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361125.044257:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3314:x1875232144086272:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361125.044258:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361125.044270:0:18606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361125.044276:0:18606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6611c0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611c03 expref: 19 pid: 18614 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361125.044282:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361125.044287:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3311:1875232144086528:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361125.044290:0:18606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6611c0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6611c03 expref: 19 pid: 18614 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.044306:0:18606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361125.044320:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361125.044333:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3314:x1875232144086272:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361125.044339:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361125.044343:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144086400 00000100:00100000:0.0:1788361125.044345:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144086400 00000100:00100000:3.0:1788361125.044349:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144086528 00000100:00100000:3.0:1788361125.044351:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144086528 00010000:00010000:3.0:1788361125.044359:0:18606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d6611a66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611a5f expref: 20 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044359:0:18604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d6611ab3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611aac expref: 20 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361125.044372:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361125.044376:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89868cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+20:3311:x1875232144086528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361125.044383:0:18606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361125.044387:0:18606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d6611a66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611a5f expref: 20 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.044394:0:18606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d6611a66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6611a5f expref: 20 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.044403:0:18606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361125.044429:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89868cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+20:3311:x1875232144086528:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (109us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361125.044431:0:20634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6611c0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6611c03 expref: 20 pid: 18614 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361125.044441:0:20634:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20634:1875232144085888:0@lo:104: 00000100:00100000:1.0:1788361125.044450:0:20634:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20634:1875232144086016:0@lo:104: 00010000:00010000:1.0:1788361125.044457:0:20634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e400/0xf6a94c97d6611a66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6611a5f expref: 19 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361125.044465:0:20634:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20634:1875232144086144:0@lo:104: 00000100:00100000:0.0:1788361125.044863:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361125.044872:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:3311:x1875232144086400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361125.044880:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361125.044884:0:18604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d6611ab3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6611aac expref: 18 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044893:0:18604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d6611ab3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6611aac expref: 18 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044903:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d6611ab3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6611aac expref: 18 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.044911:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361125.044937:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:3311:x1875232144086400:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361125.044943:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361125.046248:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361125.046337:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3314:1875232144086272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361125.046371:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3311:1875232144086528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361125.046398:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3311:1875232144086400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361125.048582:0:20634:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20634:1875232144085632:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361125.048595:0:20634:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20634:1875232144085760:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361125.048713:0:20634:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361125.056784:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361125.058337:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130471680 00000100:00100000:3.0:1788361125.058350:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130471680 00010000:00010000:3.0:1788361125.058406:0:18604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611d7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d9 expref: 13 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361125.058458:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788361125.058468:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:2349:x1875232130471680:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361125.058488:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361125.058494:0:18604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611d7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d9 expref: 13 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.058521:0:18604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611d7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d9 expref: 13 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.058544:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611d7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d9 expref: 13 pid: 18613 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.058559:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361125.058636:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:2349:x1875232130471680:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 169us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361125.058643:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1788361125.058751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361125.058901:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130471808 00000100:00100000:3.0:1788361125.058906:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130471808 00010000:00010000:3.0:1788361125.059073:0:18606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e777 expref: 12 pid: 18612 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361125.059212:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361125.059234:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:2349:x1875232130471808:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361125.059244:0:18606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361125.059250:0:18606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611d45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e777 expref: 12 pid: 18612 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059261:0:18606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611d45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e777 expref: 12 pid: 18612 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059273:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611d45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e777 expref: 12 pid: 18612 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059285:0:18606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059294:0:18606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059307:0:18606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059314:0:18606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059321:0:18606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059330:0:18606:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059344:0:18606:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361125.059348:0:18606:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059362:0:18606:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059389:0:18606:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361125.059406:0:18606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361125.059445:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:2349:x1875232130471808:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 212us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361125.059452:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:0.0:1788361125.060997:0:20634:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.061014:0:20634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361125.061021:0:20634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573fe00/0xf6a94c97d6611da7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361125.517629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361125.517678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361125.517711:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361125.517740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361125.517762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361125.517786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361125.517807:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130472192 00000100:00100000:2.0:1788361125.517816:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130472192 00000100:00100000:2.0:1788361125.517861:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130472448 00000100:00100000:2.0:1788361125.517863:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130472448 00000100:00100000:2.0:1788361125.517877:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130472064 00000100:00100000:2.0:1788361125.517880:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130472064 00000100:00100000:2.0:1788361125.517897:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130472576 00000100:00100000:2.0:1788361125.517900:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130472576 00000100:00100000:1.0:1788361125.517906:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361125.517916:0:19254:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788361125.517925:0:19254:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788361125.517933:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+5:2349:x1875232130472192:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361125.517952:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130471936 00000100:00100000:2.0:1788361125.517956:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130471936 00000100:00100000:2.0:1788361125.517982:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130472320 00000100:00100000:2.0:1788361125.517985:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130472320 00000100:00100000:2.0:1788361125.518006:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361125.518015:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2349:x1875232130471936:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361125.518022:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+5:2349:x1875232130472192:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 104us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361125.518032:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361125.518052:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2349:x1875232130471936:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 36us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361125.518057:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361125.518063:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361125.518081:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361125.518112:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2329b358-e201-4b49-9217-354f420c399f+5:2349:x1875232130472448:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361125.518122:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+6:2349:x1875232130472320:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361125.518147:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2329b358-e201-4b49-9217-354f420c399f+5:2349:x1875232130472448:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 68us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361125.518154:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361125.518165:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+6:2349:x1875232130472320:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 45us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361125.518171:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788361125.518176:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361125.518184:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+5:2349:x1875232130472064:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:2.0:1788361125.518197:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361125.518202:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361125.518204:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361125.518225:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+5:2349:x1875232130472064:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 44us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361125.518232:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361125.518248:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361125.518255:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2329b358-e201-4b49-9217-354f420c399f+5:2349:x1875232130472576:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361125.518279:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2329b358-e201-4b49-9217-354f420c399f+5:2349:x1875232130472576:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361125.518286:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:0.0:1788361125.920321:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361125.976281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361125.976393:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130472704 00000100:00100000:2.0:1788361125.976403:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130472704 00000100:00100000:2.0:1788361125.976469:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361125.976479:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+6:17260:x1875232130472704:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361125.976499:0:18621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361125.976531:0:18621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611dae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e80a expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.976599:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611db5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.976614:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.976635:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.976651:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.976659:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.976666:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977254:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6611dc3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977265:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6611dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977273:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6611dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361125.977363:0:18621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788361125.977368:0:18621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361125.977465:0:18621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6611dc3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977475:0:18621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611db5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977497:0:18621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611db5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977513:0:18621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611db5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977520:0:18621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361125.977524:0:18621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611db5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977532:0:18621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611db5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977544:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:2.0:1788361125.977554:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361125.977558:0:18621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611db5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977564:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611db5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977578:0:18621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977584:0:18621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dbc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977589:0:18621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977594:0:18621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361125.977596:0:18621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977603:0:18621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dbc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977610:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a8aa8ee1900) 00010000:00010000:2.0:1788361125.977612:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361125.977615:0:18621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dbc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977620:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977655:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611dae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e80a expref: 8 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977679:0:18621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6611dc3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e80a expref: 7 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.977686:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8aa8ee1200) 00010000:00010000:2.0:1788361125.977688:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361125.977690:0:18621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:2.0:1788361125.977757:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+7:17260:x1875232130472704:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1278us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361125.977764:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:1.0:1788361125.987050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361125.987173:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130472960 00000100:00100000:2.0:1788361125.987182:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130472960 00000100:00100000:2.0:1788361125.987242:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788361125.987253:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+7:17260:x1875232130472960:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361125.987276:0:18620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361125.987294:0:18620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611dca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e811 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.987372:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dd1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.987388:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.987400:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.987473:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611dd8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.987495:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.987503:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988252:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6611ddf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988265:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6611ddf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988272:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6611ddf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361125.988288:0:18620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788361125.988549:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dd1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988556:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dd1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988562:0:18620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988568:0:18620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361125.988572:0:18620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dd1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988580:0:18620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dd1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988604:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8aa8ee1200) 00010000:00010000:2.0:1788361125.988607:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361125.988611:0:18620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dd1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988617:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dd1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988629:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988634:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611dd8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988640:0:18620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988644:0:18620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361125.988646:0:18620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988651:0:18620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611dd8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988658:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8aa8ee1900) 00010000:00010000:2.0:1788361125.988660:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361125.988662:0:18620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611dd8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.988667:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611dd8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.994078:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611dca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e811 expref: 10 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.994136:0:18620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6611ddf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e811 expref: 9 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361125.994146:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:2.0:1788361125.994149:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361125.994153:0:18620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e000, rc 0) 00000100:00100000:2.0:1788361125.994233:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+9:17260:x1875232130472960:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 6980us (7191us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788361125.994243:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:3.0:1788361126.003293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.003586:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130473088 00000100:00100000:2.0:1788361126.003597:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130473088 00000100:00100000:2.0:1788361126.003647:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1788361126.003657:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+9:17260:x1875232130473088:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788361126.003762:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+9:17260:x1875232130473088:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 105us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361126.003769:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361126.042195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.042275:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130473216 00000100:00100000:2.0:1788361126.042287:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130473216 00000100:00100000:2.0:1788361126.042349:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361126.042359:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+9:17266:x1875232130473216:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361126.042381:0:18619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361126.042400:0:18619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611ded lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e818 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.042483:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611df4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.042497:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611df4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.042516:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611df4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.042580:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dfb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.042588:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.042595:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043042:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611df4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043050:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611df4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043057:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611df4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043063:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361126.043067:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611df4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043117:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611df4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043131:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:2.0:1788361126.043134:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361126.043138:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611df4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043144:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611df4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043157:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dfb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043163:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dfb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043168:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043173:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361126.043175:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dfb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043181:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dfb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043189:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a8aa8ee1900) 00010000:00010000:2.0:1788361126.043191:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361126.043194:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dfb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043211:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611dfb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043245:0:18619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611ded lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e818 expref: 10 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043255:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:2.0:1788361126.043257:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361126.043260:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611ded lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e818 expref: 10 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.043268:0:18619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:2.0:1788361126.043330:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+9:17266:x1875232130473216:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 972us (1143us total) trans 0 rc 301/301 00000100:00100000:2.0:1788361126.043338:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1788361126.052967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361126.053808:0:18628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130473344 00000100:00100000:3.0:1788361126.053819:0:18628:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130473344 00000100:00100000:3.0:1788361126.053876:0:18628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361126.053887:0:18628:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6dc24666-75f2-466e-bd74-ac2809e63d73+9:17266:x1875232130473344:12345-192.168.203.60@tcp:700:lfs.0 00000100:00100000:3.0:1788361126.053981:0:18628:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6dc24666-75f2-466e-bd74-ac2809e63d73+9:17266:x1875232130473344:12345-192.168.203.60@tcp:700:lfs.0 Request processed in 96us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361126.053989:0:18628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361126.057251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.057342:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130473600 00000100:00100000:2.0:1788361126.057352:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130473600 00000100:00100000:2.0:1788361126.057421:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:2.0:1788361126.057432:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+9:17266:x1875232130473600:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:2.0:1788361126.057487:0:18621:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361126.057528:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6611d68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7a1 expref: 9 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.057548:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:2.0:1788361126.057553:0:18621:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361126.057833:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.057855:0:18621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e803 expref: 5 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.057863:0:18621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.057896:0:18621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e803 expref: 5 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.057909:0:18621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e803 expref: 5 pid: 18652 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361126.057924:0:18621:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18621:1875232144086656:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361126.058020:0:18621:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83190180 going to sleep for 11 seconds 00000100:00100000:2.0:1788361126.064962:0:18621:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18621:1875232144086656:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361126.064971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:2.0:1788361126.064996:0:18621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.065067:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130473728 00000100:00100000:3.0:1788361126.065075:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130473728 00010000:00010000:3.0:1788361126.065140:0:18604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e803 expref: 6 pid: 18652 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.065173:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361126.065240:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2329b358-e201-4b49-9217-354f420c399f+6:2349:x1875232130473728:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361126.065256:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361126.065332:0:18604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e803 expref: 6 pid: 18652 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.065346:0:18604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e803 expref: 6 pid: 18652 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.065367:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611da0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e803 expref: 6 pid: 18652 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.065380:0:18604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:3.0:1788361126.065384:0:18604:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.065451:0:18604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.065462:0:18604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.065485:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361126.065553:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2329b358-e201-4b49-9217-354f420c399f+5:2349:x1875232130473728:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 316us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361126.065561:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00010000:00010000:2.0:1788361126.065614:0:18621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.065622:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.065644:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611e09 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.065654:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.065669:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361126.068671:0:18621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788361126.068691:0:18621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.068700:0:18621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.068708:0:18621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.068716:0:18621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361126.068720:0:18621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.068729:0:18621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.068746:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:2.0:1788361126.068749:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361126.068753:0:18621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.068759:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e02 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361126.068779:0:18621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003428ca30 reply state 000000004e3d7cf4 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361126.068970:0:18621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361126.069070:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+10:17266:x1875232130473600:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 11635us (11824us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788361126.069079:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00010000:00010000:0.0:1788361126.070751:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611e09 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.070763:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611e09 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.070770:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611e09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.070785:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361126.070790:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611e09 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.070893:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611e09 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.070907:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a8aa8ee1900) 00010000:00010000:0.0:1788361126.070909:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361126.070913:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611e09 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.070919:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611e09 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361126.172694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.175390:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130473856 00000100:00100000:2.0:1788361126.175405:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130473856 00000100:00100000:2.0:1788361126.175477:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:2.0:1788361126.175488:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+9:17274:x1875232130473856:12345-192.168.203.60@tcp:101:lctl.0 00010000:00010000:2.0:1788361126.175520:0:18620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361126.175543:0:18620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e81f expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.175607:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611e17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.175620:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.175632:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361126.176015:0:18620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361126.176020:0:18620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361126.176061:0:18620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611e17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.176107:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e81f expref: 11 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.176146:0:18620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6611e17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e81f expref: 10 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.176155:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788361126.176158:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361126.176161:0:18620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:2.0:1788361126.176284:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+10:17274:x1875232130473856:12345-192.168.203.60@tcp:101:lctl.0 Request processed in 797us (3598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361126.176292:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788361126.202438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.202535:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130473984 00000100:00100000:0.0:1788361126.202545:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130473984 00000100:00100000:0.0:1788361126.202661:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361126.202672:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2329b358-e201-4b49-9217-354f420c399f+5:17275:x1875232130473984:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361126.202694:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361126.202715:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611e1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e826 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.202788:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6611e25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.202801:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6611e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.202813:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6611e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361126.202869:0:18652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361126.202872:0:18652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361126.202895:0:18652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6611e25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.202918:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611e1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e826 expref: 7 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.202935:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6611e25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e826 expref: 6 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.202962:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:0.0:1788361126.202965:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361126.202968:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964e00, rc 0) 00000100:00100000:0.0:1788361126.203026:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2329b358-e201-4b49-9217-354f420c399f+6:17275:x1875232130473984:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 356us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361126.203034:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788361126.205926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361126.211209:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130474112 00000100:00100000:3.0:1788361126.211225:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130474112 00000100:00100000:3.0:1788361126.211300:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361126.211310:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2329b358-e201-4b49-9217-354f420c399f+6:17275:x1875232130474112:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361126.211344:0:18619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361126.211366:0:18619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6611e2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e82d expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.211956:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611e33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.211972:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.211984:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.211999:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611e3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212005:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212011:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212317:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6611e41 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212326:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6611e41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212332:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6611e41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361126.212369:0:18619:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788361126.212380:0:18619:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361126.212411:0:18619:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6611e41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212435:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611e33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212440:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611e33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212446:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611e33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212451:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361126.212455:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611e33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212461:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611e33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212473:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:3.0:1788361126.212475:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361126.212479:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611e33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212484:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611e33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212494:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611e3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212500:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611e3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212524:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611e3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212529:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361126.212532:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611e3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212537:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611e3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212545:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a8a99526600) 00010000:00010000:3.0:1788361126.212547:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361126.212550:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611e3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212556:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611e3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212590:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6611e2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e82d expref: 8 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212603:0:18619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6611e41 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e82d expref: 7 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.212610:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:3.0:1788361126.212612:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361126.212614:0:18619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f600, rc 0) 00000100:00100000:3.0:1788361126.212673:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2329b358-e201-4b49-9217-354f420c399f+7:17275:x1875232130474112:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1364us (6754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361126.212689:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361126.219364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.219519:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130474368 00000100:00100000:2.0:1788361126.219529:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130474368 00000100:00100000:2.0:1788361126.219592:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1788361126.219602:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+7:17275:x1875232130474368:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361126.219622:0:18621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361126.219652:0:18621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e834 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361126.219773:0:18621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788361126.220524:0:18621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e48 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e834 expref: 9 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.220539:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788361126.220542:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361126.220547:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e834 expref: 9 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.220575:0:18621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:2.0:1788361126.220663:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+8:17275:x1875232130474368:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1062us (1309us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788361126.220671:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1788361126.229215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.234443:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130474624 00000100:00100000:2.0:1788361126.234458:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130474624 00000100:00100000:2.0:1788361126.234639:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788361126.234650:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2329b358-e201-4b49-9217-354f420c399f+8:17275:x1875232130474624:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:2.0:1788361126.234706:0:18620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361126.234734:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6611e41 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e82d expref: 8 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.234753:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8a99526f00) 00010000:00010000:2.0:1788361126.234764:0:18620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361126.234788:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e56 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.234802:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.234812:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361126.235028:0:18620:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b1579db9 reply state 000000003a20ac84 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361126.235038:0:18620:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788361126.235065:0:18620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1788361126.235194:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2329b358-e201-4b49-9217-354f420c399f+9:17275:x1875232130474624:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 546us (6116us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788361126.235202:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:1.0:1788361126.238688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:3.0:1788361126.238780:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361126.238789:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130474880 00010000:00010000:3.0:1788361126.238791:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e56 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.238800:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e56 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361126.238800:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130474880 00010000:00010000:3.0:1788361126.238809:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361126.238813:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e56 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.238821:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e56 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.238840:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8aa8ee1f00) 00010000:00010000:3.0:1788361126.238843:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788361126.238847:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e56 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.238852:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611e56 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361126.238859:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:2.0:1788361126.238871:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2329b358-e201-4b49-9217-354f420c399f+9:17275:x1875232130474880:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361126.239147:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2329b358-e201-4b49-9217-354f420c399f+9:17275:x1875232130474880:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 278us (466us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788361126.239155:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000040:00080000:2.0:1788361126.241010:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788361126.241765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.241856:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130475136 00000100:00100000:0.0:1788361126.241867:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130475136 00000100:00100000:0.0:1788361126.241939:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:0.0:1788361126.241948:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2329b358-e201-4b49-9217-354f420c399f+9:17275:x1875232130475136:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361126.241969:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361126.241989:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611e5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e83b expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.242081:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611e64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.242170:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.242181:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.242195:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611e6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.242203:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.242238:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361126.242362:0:18652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788361126.242990:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611e64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.242999:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611e64 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243006:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611e64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243012:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361126.243017:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611e64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243076:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611e64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243245:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:0.0:1788361126.243249:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361126.243255:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611e64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243261:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611e64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243275:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611e6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243292:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611e6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243298:0:18652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611e6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243304:0:18652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361126.243307:0:18652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611e6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243313:0:18652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611e6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243321:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a8a890c3200) 00010000:00010000:0.0:1788361126.243323:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361126.243326:0:18652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611e6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243331:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611e6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243376:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611e5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e83b expref: 11 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243387:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:0.0:1788361126.243389:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361126.243393:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611e5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e83b expref: 11 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.243485:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964c00, rc 0) 00000100:00100000:0.0:1788361126.243596:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2329b358-e201-4b49-9217-354f420c399f+10:17275:x1875232130475136:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1649us (1835us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788361126.243604:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788361126.246390:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.246612:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130475264 00000100:00100000:0.0:1788361126.246621:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130475264 00000100:00100000:0.0:1788361126.246721:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788361126.246732:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2329b358-e201-4b49-9217-354f420c399f+10:17275:x1875232130475264:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361126.246757:0:18619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361126.246779:0:18619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6611e79 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e842 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.246875:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.246890:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.246911:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361126.247293:0:18619:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788361126.247298:0:18619:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361126.247321:0:18619:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.247347:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6611e79 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e842 expref: 12 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.247381:0:18619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e842 expref: 11 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.247389:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:0.0:1788361126.247392:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361126.247395:0:18619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965000, rc 0) 00000100:00100000:0.0:1788361126.247459:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2329b358-e201-4b49-9217-354f420c399f+11:17275:x1875232130475264:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 729us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361126.247467:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:1.0:1788361126.252364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.252532:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130475392 00000100:00100000:2.0:1788361126.252542:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130475392 00000100:00100000:2.0:1788361126.252600:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:2.0:1788361126.252610:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2329b358-e201-4b49-9217-354f420c399f+11:17275:x1875232130475392:12345-192.168.203.60@tcp:37:lfs.0 00000100:00100000:2.0:1788361126.260041:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2329b358-e201-4b49-9217-354f420c399f+11:17275:x1875232130475392:12345-192.168.203.60@tcp:37:lfs.0 Request processed in 7414us (7667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361126.260055:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1788361126.263605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.263723:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130475648 00000100:00100000:0.0:1788361126.263734:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130475648 00000100:00100000:0.0:1788361126.263820:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788361126.263831:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0867850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2329b358-e201-4b49-9217-354f420c399f+11:17275:x1875232130475648:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361126.264152:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0867850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2329b358-e201-4b49-9217-354f420c399f+12:17275:x1875232130475648:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 322us (557us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788361126.264160:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1788361126.313174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.313819:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130475776 00000100:00100000:2.0:1788361126.313829:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130475776 00000100:00100000:2.0:1788361126.313892:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1788361126.313902:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+10:17281:x1875232130475776:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361126.313922:0:18621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361126.313943:0:18621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6611e87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e849 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314027:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611e8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314043:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611e8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314053:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611e8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314163:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611e95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314171:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314179:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314297:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6611e9c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314306:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6611e9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314397:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6611e9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361126.314433:0:18621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788361126.314437:0:18621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361126.314476:0:18621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6611e9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314499:0:18621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611e8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314517:0:18621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611e8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314523:0:18621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611e8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314529:0:18621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361126.314533:0:18621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611e8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314540:0:18621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611e8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314552:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:2.0:1788361126.314555:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361126.314559:0:18621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611e8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314565:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611e8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314578:0:18621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611e95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314584:0:18621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611e95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314590:0:18621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611e95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314602:0:18621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361126.314606:0:18621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611e95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314612:0:18621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611e95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314620:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9a8aa8ee1b00) 00010000:00010000:2.0:1788361126.314622:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361126.314624:0:18621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611e95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314631:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611e95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314662:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6611e87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e849 expref: 12 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314675:0:18621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6611e9c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e849 expref: 11 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.314683:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:2.0:1788361126.314685:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788361126.314688:0:18621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e200, rc 0) 00000100:00100000:2.0:1788361126.314818:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+11:17281:x1875232130475776:12345-192.168.203.60@tcp:101:bash.0 Request processed in 917us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361126.314825:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:1.0:1788361126.324297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.324489:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130476032 00000100:00100000:2.0:1788361126.324703:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130476032 00000100:00100000:2.0:1788361126.324817:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:2.0:1788361126.324828:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+11:17281:x1875232130476032:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361126.324850:0:18620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361126.324870:0:18620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6611ea3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e850 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.324982:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.324996:0:18620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e842 expref: 11 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.325005:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.325034:0:18620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e842 expref: 11 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.325047:0:18620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e842 expref: 11 pid: 18619 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361126.325238:0:18620:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18620:1875232144086784:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361126.325352:0:18620:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361126.329451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361126.329539:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130476160 00000100:00100000:3.0:1788361126.329548:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130476160 00010000:00010000:3.0:1788361126.329585:0:18606:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e842 expref: 12 pid: 18619 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.329645:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1788361126.329655:0:18620:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18620:1875232144086784:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361126.329656:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2329b358-e201-4b49-9217-354f420c399f+12:2350:x1875232130476160:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361126.329678:0:18606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361126.329686:0:18606:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e842 expref: 12 pid: 18619 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.329688:0:18620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.329702:0:18606:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e842 expref: 12 pid: 18619 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.329840:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611e80 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e842 expref: 12 pid: 18619 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.329858:0:18606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:3.0:1788361126.329864:0:18606:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.329873:0:18606:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.329881:0:18606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.329904:0:18606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361126.329938:0:18620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.329947:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.329956:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2329b358-e201-4b49-9217-354f420c399f+11:2350:x1875232130476160:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 301us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361126.329964:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00010000:00010000:2.0:1788361126.330020:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611eb1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.330032:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611eb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.330040:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611eb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.331061:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611eb8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.331073:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611eb8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.331081:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611eb8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361126.331119:0:18620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788361126.331144:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.331148:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.331153:0:18620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.331162:0:18620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361126.331165:0:18620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.331170:0:18620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.331177:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:2.0:1788361126.331179:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361126.331182:0:18620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.331186:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611eaa lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361126.331193:0:18620:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000020a69a29 reply state 0000000023da61b4 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611eb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361126.331198:0:18620:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361126.331225:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6611ea3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e850 expref: 14 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.331234:0:18620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611eb8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e850 expref: 13 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.331239:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:2.0:1788361126.331240:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788361126.331242:0:18620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ec00, rc 0) 00000100:00100000:2.0:1788361126.331296:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+14:17281:x1875232130476032:12345-192.168.203.60@tcp:101:bash.0 Request processed in 6471us (7009us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788361126.331306:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00010000:00010000:0.0:1788361126.333259:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611eb1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.333277:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611eb1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.333284:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611eb1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.333290:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361126.333306:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611eb1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.333314:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611eb1 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.333327:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9a8aa8ee1b00) 00010000:00010000:0.0:1788361126.333330:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361126.333334:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611eb1 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.333341:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6611eb1 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361126.351905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.352000:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130476288 00000100:00100000:2.0:1788361126.352010:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130476288 00000100:00100000:2.0:1788361126.352074:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:2.0:1788361126.352105:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+13:17281:x1875232130476288:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361126.352130:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361126.352150:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6611ec6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e857 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.352218:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.352234:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.352246:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361126.352284:0:18652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788361126.352288:0:18652:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361126.352308:0:18652:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.352318:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.352343:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6611ec6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e857 expref: 15 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.352360:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e857 expref: 14 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.352385:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:2.0:1788361126.352388:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361126.352392:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e600, rc 0) 00000100:00100000:2.0:1788361126.352455:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+14:17281:x1875232130476288:12345-192.168.203.60@tcp:101:bash.0 Request processed in 371us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361126.352463:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:1.0:1788361126.358753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.358841:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130476544 00000100:00100000:2.0:1788361126.358851:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130476544 00000100:00100000:2.0:1788361126.358916:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361126.358927:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+14:17281:x1875232130476544:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1788361126.359286:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+15:17281:x1875232130476544:12345-192.168.203.60@tcp:35:bash.0 Request processed in 361us (543us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788361126.359294:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788361126.424793:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.424951:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130476800 00000100:00100000:0.0:1788361126.424961:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130476800 00000100:00100000:0.0:1788361126.425026:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:0.0:1788361126.425036:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+15:17291:x1875232130476800:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361126.425061:0:18619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361126.425080:0:18619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6611ed4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e85e expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361126.425210:0:18619:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788361126.425317:0:18619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6611ed4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e85e expref: 17 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.425331:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1800) 00010000:00010000:0.0:1788361126.425334:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361126.425339:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6611ed4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e85e expref: 17 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.425368:0:18619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964a00, rc 0) 00000100:00100000:0.0:1788361126.425426:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+16:17291:x1875232130476800:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 391us (643us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788361126.425433:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361126.429973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.430306:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130477056 00000100:00100000:2.0:1788361126.430317:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130477056 00000100:00100000:2.0:1788361126.430397:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788361126.430407:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+16:17291:x1875232130477056:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361126.430770:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+17:17291:x1875232130477056:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 363us (807us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788361126.430778:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361126.463860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.465637:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130477312 00000100:00100000:0.0:1788361126.465649:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130477312 00000100:00100000:0.0:1788361126.465716:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788361126.465726:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+17:17294:x1875232130477312:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361126.465748:0:18621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361126.465767:0:18621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6611ee2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e865 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.466008:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611ee9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.466025:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611ee9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.466038:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611ee9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361126.466052:0:18621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788361126.466192:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6611ee2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e865 expref: 20 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.466211:0:18621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611ee9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e865 expref: 19 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.466236:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:0.0:1788361126.466239:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361126.466242:0:18621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964c00, rc 0) 00000100:00100000:0.0:1788361126.466357:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+19:17294:x1875232130477312:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 632us (2505us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788361126.466376:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1788361126.469879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361126.469977:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.470063:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130477568 00000100:00100000:0.0:1788361126.470073:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130477568 00000100:00100000:0.0:1788361126.470158:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:0.0:1788361126.470168:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+19:17294:x1875232130477568:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:0.0:1788361126.470229:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611ef7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.470245:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611ef7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.470257:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611ef7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.470283:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611ef7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.470289:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611ef7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.470296:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611ef7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.470302:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361126.470318:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611ef7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.470326:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611ef7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.470337:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:0.0:1788361126.470340:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361126.470356:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611ef7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.470362:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6611ef7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.470434:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130477440 00000100:00100000:0.0:1788361126.470436:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+19:17294:x1875232130477568:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 269us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361126.470443:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130477440 00000100:00100000:0.0:1788361126.470443:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:3.0:1788361126.470489:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361126.470497:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+19:2352:x1875232130477440:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361126.470519:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361126.470534:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611ee9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e865 expref: 19 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.470544:0:18604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:3.0:1788361126.470547:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361126.470565:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+18:2352:x1875232130477440:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 70us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361126.470571:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361126.472897:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.472976:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130477824 00000100:00100000:0.0:1788361126.472984:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130477824 00000100:00100000:0.0:1788361126.473030:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361126.473038:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+18:17294:x1875232130477824:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361126.473276:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+19:17294:x1875232130477824:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 238us (386us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788361126.473284:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 10000000:01000000:2.0:1788361126.560202:0:18616:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788361126.560210:0:18616:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a9efca800 from 10 10000000:01000000:2.0:1788361126.560216:0:18616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788361126.560266:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.560296:0:18616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.560308:0:18616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361126.560333:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144086912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361126.560405:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361126.560570:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361126.561968:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144086912 00000100:00100000:1.0:1788361126.561982:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144086912 00000100:00100000:1.0:1788361126.562049:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788361126.562060:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:18616:x1875232144086912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361126.562077:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361126.562112:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611f05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611efe expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.562631:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611f05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611efe expref: 17 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.562644:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6611f05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611efe expref: 17 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.562653:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb600, rc 0) 00000100:00100000:1.0:1788361126.562775:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:18616:x1875232144086912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 718us (2370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361126.562783:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788361126.562875:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144086912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361126.562892:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.562902:0:18616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361126.562968:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361126.563000:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361126.564058:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361126.564833:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144087040 00000100:00100000:0.0:1788361126.564842:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144087040 00000100:00100000:0.0:1788361126.564942:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788361126.564952:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:18616:x1875232144087040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361126.565261:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:18616:x1875232144087040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361126.565276:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788361126.565379:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361126.565431:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361126.565475:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361126.567748:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361126.570336:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144087168 00000100:00100000:2.0:1788361126.570472:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144087168 00000100:00100000:2.0:1788361126.570617:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788361126.570628:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:18616:x1875232144087168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361126.570934:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:18616:x1875232144087168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 307us (5457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361126.570941:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788361126.571711:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361126.574390:0:20648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788361126.574852:0:18616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788361126.574880:0:18616:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361126.574891:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.574902:0:18616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361126.574911:0:18616:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361126.574927:0:18616:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a8370e000 from 10 10000000:01000000:3.0:1788361126.574930:0:18616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361126.574965:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f200/0xf6a94c97d6611f0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.574973:0:18616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f200/0xf6a94c97d6611f0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.574984:0:18616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f200/0xf6a94c97d6611f0c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.575012:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361126.575077:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361126.575285:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361126.575428:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144087296 00000100:00100000:1.0:1788361126.575435:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144087296 00000100:00100000:1.0:1788361126.575569:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788361126.575579:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:18616:x1875232144087296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361126.575592:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361126.575606:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611f13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611f0c expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.575629:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611f13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611f0c expref: 18 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.575639:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6611f13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611f0c expref: 18 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.575648:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca800, rc 0) 00000100:00100000:1.0:1788361126.576017:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:18616:x1875232144087296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 439us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361126.576025:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788361126.576201:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361126.576215:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f200/0xf6a94c97d6611f0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611f13 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.576225:0:18616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f200/0xf6a94c97d6611f0c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611f13 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.576277:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361126.576305:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361126.576324:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361126.578460:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144087424 00000100:00100000:2.0:1788361126.578473:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144087424 00000100:00100000:2.0:1788361126.578592:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788361126.578603:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:18616:x1875232144087424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361126.578964:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1576450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:18616:x1875232144087424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 362us (2657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361126.578972:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788361126.579190:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361126.579236:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361126.579281:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361126.579358:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361126.579435:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144087552 00000100:00100000:0.0:1788361126.579440:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144087552 00000100:00100000:0.0:1788361126.579463:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788361126.579469:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:18616:x1875232144087552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361126.579620:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:18616:x1875232144087552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361126.579627:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788361126.579753:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361126.580640:0:20649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788361126.581259:0:18616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788361126.581276:0:18616:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361126.581286:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f200/0xf6a94c97d6611f0c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611f13 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.581298:0:18616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f200/0xf6a94c97d6611f0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611f13 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361126.581308:0:18616:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361126.581310:0:18616:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8ab6fbc800 from 10 10000000:01000000:0.0:1788361126.581313:0:18616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361126.581343:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d6611f1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.581351:0:18616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d6611f1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.581360:0:18616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d6611f1a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361126.581394:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361126.581445:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361126.581474:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90955300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361126.581541:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144087680 00000100:00100000:1.0:1788361126.581548:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144087680 00000100:00100000:1.0:1788361126.581592:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788361126.581601:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+18:18616:x1875232144087680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361126.581612:0:18612:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361126.581625:0:18612:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d6611f21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6611f1a expref: -99 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.581645:0:18612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d6611f21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6611f1a expref: 19 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.581655:0:18612:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d6611f21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6611f1a expref: 19 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.581670:0:18612:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcae00, rc 0) 00000100:00100000:1.0:1788361126.581716:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1576050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:18616:x1875232144087680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361126.581809:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788361126.581894:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361126.581908:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d6611f1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611f21 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.581916:0:18616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d6611f1a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611f21 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.581961:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361126.581988:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361126.582011:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a850819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361126.582050:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144087808 00000100:00100000:0.0:1788361126.582053:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144087808 00000100:00100000:0.0:1788361126.582110:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788361126.582118:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:18616:x1875232144087808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361126.582340:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:18616:x1875232144087808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361126.582348:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788361126.582419:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361126.582444:0:18616:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361126.582481:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361126.582550:0:18616:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a850819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361126.582633:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144087936 00000100:00100000:0.0:1788361126.582637:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144087936 00000100:00100000:0.0:1788361126.582655:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788361126.582661:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:18616:x1875232144087936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361126.582862:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:18616:x1875232144087936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361126.582868:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788361126.582932:0:18616:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:18616:1875232144087936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361126.583901:0:20650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788361126.584069:0:18616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788361126.584222:0:18616:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361126.584231:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d6611f1a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611f21 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.584242:0:18616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d6611f1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611f21 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361126.599161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.599363:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130477952 00000100:00100000:0.0:1788361126.599373:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130477952 00000100:00100000:0.0:1788361126.599429:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:0.0:1788361126.599439:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:16649:x1875232130477952:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361126.599456:0:18613:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361126.599474:0:18613:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964a00/0xf6a94c97d6611f28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e86c expref: -99 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.599531:0:18613:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964a00/0xf6a94c97d6611f28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e86c expref: 12 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.599542:0:18613:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964a00/0xf6a94c97d6611f28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e86c expref: 12 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.599550:0:18613:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964a00, rc 0) 00000100:00100000:0.0:1788361126.599650:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:16649:x1875232130477952:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 212us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361126.599656:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:1.0:1788361126.607805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.608275:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130478080 00000100:00100000:2.0:1788361126.608284:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130478080 00000100:00100000:2.0:1788361126.608395:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:2.0:1788361126.608406:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:16649:x1875232130478080:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361126.608843:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:16649:x1875232130478080:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 437us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361126.608852:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:1.0:1788361126.615171:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.615228:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130478208 00000100:00100000:0.0:1788361126.615236:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130478208 00000100:00100000:0.0:1788361126.615280:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:0.0:1788361126.615288:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:16649:x1875232130478208:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361126.615538:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:16649:x1875232130478208:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 249us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361126.615546:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1788361126.626374:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.626516:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130478336 00000100:00100000:2.0:1788361126.626640:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130478336 00000100:00100000:2.0:1788361126.626702:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:2.0:1788361126.626712:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:16649:x1875232130478336:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361126.626730:0:18614:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361126.626749:0:18614:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573f200/0xf6a94c97d6611f2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e873 expref: -99 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.626779:0:18614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573f200/0xf6a94c97d6611f2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e873 expref: 13 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.626791:0:18614:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573f200/0xf6a94c97d6611f2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e873 expref: 13 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.626819:0:18614:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f200, rc 0) 00000100:00100000:2.0:1788361126.626884:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16649:x1875232130478336:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 173us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361126.626892:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:0.0:1788361126.629787:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361126.629990:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130478464 00000100:00100000:1.0:1788361126.630001:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130478464 00000100:00100000:1.0:1788361126.630825:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:1.0:1788361126.630840:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16649:x1875232130478464:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361126.631180:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16649:x1875232130478464:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 343us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361126.631189:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:3.0:1788361126.634813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361126.634935:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130478592 00000100:00100000:1.0:1788361126.635040:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130478592 00000100:00100000:1.0:1788361126.635148:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:1.0:1788361126.635159:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16649:x1875232130478592:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361126.635644:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:16649:x1875232130478592:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 485us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361126.635652:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:3.0:1788361126.660487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361126.660745:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130478848 00000100:00100000:2.0:1788361126.660756:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130478848 00000100:00100000:2.0:1788361126.660812:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:2.0:1788361126.660823:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+19:17327:x1875232130478848:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:2.0:1788361126.660850:0:18652:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361126.660871:0:18652:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611f36 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e87a expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.660979:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611f3d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.660991:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611f3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.661000:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611f3d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361126.661007:0:18652:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788361126.661160:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611f36 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e87a expref: 22 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.661179:0:18652:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611f3d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e87a expref: 21 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361126.661199:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:2.0:1788361126.661201:0:18652:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361126.661204:0:18652:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:2.0:1788361126.661278:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+21:17327:x1875232130478848:12345-192.168.203.60@tcp:101:cat.0 Request processed in 456us (799us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788361126.661285:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1788361126.671976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.672020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361126.672130:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130479232 00000100:00100000:3.0:1788361126.672139:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130479232 00000100:00100000:3.0:1788361126.672192:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361126.672202:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+21:2352:x1875232130479232:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361126.672218:0:18606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361126.672242:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611f3d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e87a expref: 21 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.672261:0:18606:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:3.0:1788361126.672266:0:18606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361126.672333:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+20:2352:x1875232130479232:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 132us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361126.672341:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:2.0:1788361126.672934:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130479104 00000100:00100000:2.0:1788361126.672942:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130479104 00000100:00100000:2.0:1788361126.672984:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:2.0:1788361126.672993:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+20:17327:x1875232130479104:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:2.0:1788361126.673307:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+21:17327:x1875232130479104:12345-192.168.203.60@tcp:35:cat.0 Request processed in 315us (1341us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788361126.673315:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361126.737783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361126.737874:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130479488 00000100:00100000:3.0:1788361126.737885:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130479488 00000100:00100000:3.0:1788361126.737943:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1788361126.737954:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+21:17333:x1875232130479488:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:3.0:1788361126.737979:0:18619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361126.737999:0:18619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611f4b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e881 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.738263:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611f52 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.738279:0:18619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611eb8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e850 expref: 22 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.738525:0:18619:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e857 expref: 22 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.738535:0:18619:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611f52 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.738569:0:18619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e857 expref: 22 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.738582:0:18619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e857 expref: 22 pid: 18652 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.738596:0:18619:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18619:1875232144088064:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361126.738696:0:18619:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611eb8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e850 expref: 22 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.738706:0:18619:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611eb8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e850 expref: 22 pid: 18620 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.738716:0:18619:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18619:1875232144088192:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361126.738738:0:18619:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361126.743236:0:18619:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18619:1875232144088064:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361126.743252:0:18619:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18619:1875232144088192:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361126.743277:0:18619:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611f52 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361126.743528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361126.743616:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130479616 00000100:00100000:3.0:1788361126.743623:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130479616 00010000:00010000:3.0:1788361126.743657:0:18604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e857 expref: 23 pid: 18652 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.744832:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361126.744845:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89868cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+23:2349:x1875232130479616:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361126.744863:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361126.744871:0:18604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e857 expref: 23 pid: 18652 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.744885:0:18604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e857 expref: 23 pid: 18652 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.744907:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611ecd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e857 expref: 23 pid: 18652 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.744924:0:18604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:3.0:1788361126.744930:0:18604:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611f52 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.744938:0:18604:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611f52 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.744945:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361126.745011:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89868cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+22:2349:x1875232130479616:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 169us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361126.745035:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361126.745168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361126.745788:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130479744 00000100:00100000:3.0:1788361126.745797:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130479744 00010000:00010000:3.0:1788361126.745820:0:18604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611eb8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e850 expref: 22 pid: 18620 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361126.745840:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361126.745847:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+22:2349:x1875232130479744:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361126.745856:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361126.745860:0:18604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611eb8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e850 expref: 22 pid: 18620 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.745869:0:18604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611eb8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e850 expref: 22 pid: 18620 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.745884:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611eb8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e850 expref: 22 pid: 18620 timeout: 616 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.745895:0:18604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:3.0:1788361126.745900:0:18604:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611f52 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.745907:0:18604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611f52 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.745912:0:18604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611f52 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.745973:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361126.746000:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+21:2349:x1875232130479744:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 154us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361126.746005:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00010000:00010000:1.0:1788361126.748021:0:18619:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611f52 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.748037:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611f52 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361126.748057:0:18619:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788361126.749779:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6611f4b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e881 expref: 22 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.749802:0:18619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d6611f52 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e881 expref: 21 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361126.749810:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:1.0:1788361126.749813:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788361126.749816:0:18619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e600, rc 0) 00000100:00100000:1.0:1788361126.749923:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+21:17333:x1875232130479488:12345-192.168.203.60@tcp:101:dd.0 Request processed in 11971us (12158us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788361126.749933:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361126.754556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.754637:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130480000 00000100:00100000:0.0:1788361126.754646:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130480000 00000100:00100000:0.0:1788361126.754703:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1788361126.754713:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+21:17333:x1875232130480000:12345-192.168.203.60@tcp:36:dd.0 00010000:00010000:0.0:1788361126.754996:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f60 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.755013:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.755024:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361126.755074:0:18621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788361126.755163:0:18621:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aea08fae reply state 00000000d86aaee8 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361126.755173:0:18621:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361126.755255:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+24:17333:x1875232130480000:12345-192.168.203.60@tcp:36:dd.0 Request processed in 543us (706us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788361126.755262:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000020:00080000:0.0:1788361126.755267:0:18621:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788361126.759567:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f60 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.759586:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f60 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.759593:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f60 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.759600:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361126.759605:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f60 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.759613:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f60 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.759630:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:3.0:1788361126.759633:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361126.759638:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f60 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.759645:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f60 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361126.759960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.760032:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130480128 00000100:00100000:0.0:1788361126.760042:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130480128 00000100:00100000:0.0:1788361126.760143:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:0.0:1788361126.760155:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+23:17333:x1875232130480128:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361126.760183:0:18620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361126.760208:0:18620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6611f67 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e888 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.760268:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6611f67 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e888 expref: 24 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.760281:0:18620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6611f67 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e888 expref: 24 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.760312:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:0.0:1788361126.760315:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361126.760318:0:18620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965200, rc 0) 00000100:00100000:0.0:1788361126.760370:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+24:17333:x1875232130480128:12345-192.168.203.60@tcp:101:dd.0 Request processed in 218us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361126.760377:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788361126.769629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361126.769718:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130480384 00000100:00100000:3.0:1788361126.769732:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130480384 00000100:00100000:3.0:1788361126.769862:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361126.769873:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+24:17333:x1875232130480384:12345-192.168.203.60@tcp:103:dd.0 00010000:00010000:3.0:1788361126.769890:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361126.769913:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6611f67 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e888 expref: 24 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361126.769930:0:18604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:3.0:1788361126.769935:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361126.769989:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+23:17333:x1875232130480384:12345-192.168.203.60@tcp:103:dd.0 Request processed in 117us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361126.769996:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361126.776425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.776568:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130480512 00000100:00100000:0.0:1788361126.776578:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130480512 00000100:00100000:0.0:1788361126.776634:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:0.0:1788361126.776643:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+23:17333:x1875232130480512:12345-192.168.203.60@tcp:58:dd.0 00010000:00010000:0.0:1788361126.776736:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.776753:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.776764:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361126.778047:0:18621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361126.779003:0:18621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788361126.779075:0:18621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788361126.779370:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+23:17333:x1875232130480512:12345-192.168.203.60@tcp:58:dd.0 Request processed in 2723us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361126.779381:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:2.0:1788361126.787580:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361126.787692:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130480640 00000100:00100000:0.0:1788361126.787701:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130480640 00000100:00100000:0.0:1788361126.787782:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788361126.787792:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+23:17333:x1875232130480640:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361126.787814:0:18620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361126.787834:0:18620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f75 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e88f expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.787889:0:18620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.787901:0:18620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f75 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e88f expref: 24 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.787920:0:18620:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.787932:0:18620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f75 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e88f expref: 24 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.787946:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:0.0:1788361126.787949:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361126.787953:0:18620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f75 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e88f expref: 24 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361126.787960:0:18620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964200, rc 0) 00000100:00100000:0.0:1788361126.788022:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+24:17333:x1875232130480640:12345-192.168.203.60@tcp:101:dd.0 Request processed in 232us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361126.788029:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00010000:00010000:0.0:1788361126.944333:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361127.072333:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361127.072356:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144088320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361127.072424:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361127.072549:0:19256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144088320 00000100:00100000:2.0:1788361127.072556:0:19256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144088320 00000100:00100000:2.0:1788361127.072627:0:19256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788361127.072637:0:19256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144088320:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788361127.072640:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1788361127.072678:0:19256:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361127.072736:0:19256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144088320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361127.072743:0:19256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361127.072793:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788361127.072819:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144088320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361127.073012:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144088576:0@lo:400:kworker.0 00000100:00100000:0.0:1788361127.073027:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144088832:0@lo:400:kworker.0 00000100:00100000:3.0:1788361127.073049:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361127.073074:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361127.073077:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361127.073104:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144088704:0@lo:400:kworker.0 00000100:00100000:0.0:1788361127.073125:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788361127.073134:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3313:1875232144088448:0@lo:400:kworker.0 00000100:00100000:3.0:1788361127.073135:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361127.073173:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361127.073174:0:19253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144088576 00000100:00100000:3.0:1788361127.073179:0:19253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144088576 00000100:00100000:0.0:1788361127.073199:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144088960:0@lo:400:kworker.0 00000100:00100000:3.0:1788361127.073225:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361127.073230:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361127.073237:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144088576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361127.073262:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144088832 00000100:00100000:0.0:1788361127.073267:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144088832 00000100:00100000:3.0:1788361127.073282:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144088576:12345-0@lo:400:kworker.0 Request processed in 47us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361127.073289:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361127.073299:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144088704 00000100:00100000:0.0:1788361127.073303:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144088704 00000100:00100000:0.0:1788361127.073316:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144088960 00000100:00100000:0.0:1788361127.073319:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144088960 00000100:00100000:0.0:1788361127.073334:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361127.073340:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144088832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361127.073377:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144088832:12345-0@lo:400:kworker.0 Request processed in 36us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361127.073384:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361127.073401:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361127.073407:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144088704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361127.073440:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144088704:12345-0@lo:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361127.073446:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361127.073459:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361127.073482:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144088960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361127.073544:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144088960:12345-0@lo:400:kworker.0 Request processed in 65us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361127.073550:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361127.073584:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144088960:0@lo:400:kworker.0 00000100:00100000:0.0:1788361127.073596:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144088832:0@lo:400:kworker.0 00000100:00100000:0.0:1788361127.073641:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144088448 00000100:00100000:0.0:1788361127.073644:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144088448 00000100:00100000:0.0:1788361127.073670:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788361127.073676:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3313:x1875232144088448:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361127.073707:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361127.073712:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361127.073714:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3313:x1875232144088448:12345-0@lo:400:kworker.0 Request processed in 37us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361127.073722:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788361127.073744:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3313:1875232144088448:0@lo:400:kworker.0 00000100:00100000:0.0:1788361127.073799:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144088704:0@lo:400:kworker.0 00000100:00100000:0.0:1788361127.073810:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144088576:0@lo:400:kworker.0 00000040:00080000:2.0:1788361127.264329:0:18654:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788361127.264338:0:18654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361127.265437:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788361127.265448:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788361127.265586:0:18654:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18654:1875232144089088:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788361127.265760:0:18654:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788361127.282449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361127.282552:0:18630:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130480768 00000100:00100000:3.0:1788361127.282563:0:18630:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130480768 00000100:00100000:3.0:1788361127.282642:0:18630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361127.282665:0:18630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6dc24666-75f2-466e-bd74-ac2809e63d73+25:17334:x1875232130480768:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788361127.282746:0:18630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6dc24666-75f2-466e-bd74-ac2809e63d73+25:17334:x1875232130480768:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361127.282754:0:18630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00080000:1.0:1788361127.282905:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361127.282968:0:18654:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18654:1875232144089088:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361127.284921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.285513:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130480896 00000100:00100000:2.0:1788361127.285523:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130480896 00000100:00100000:2.0:1788361127.285583:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:2.0:1788361127.285593:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+24:17334:x1875232130480896:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361127.285625:0:18621:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361127.285795:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+24:17334:x1875232130480896:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 194us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361127.285803:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:3.0:1788361127.292691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361127.293975:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130481024 00000100:00100000:0.0:1788361127.293991:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130481024 00000100:00100000:0.0:1788361127.294062:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:0.0:1788361127.294074:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+24:17334:x1875232130481024:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788361127.294190:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611f7c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294330:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611f7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294344:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611f7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294391:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f83 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294399:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294404:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294428:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f8a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294436:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294443:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361127.294676:0:18619:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788361127.294681:0:18619:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361127.294699:0:18619:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294713:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611f7c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294725:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611f7c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294730:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611f7c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294733:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361127.294736:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611f7c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294742:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611f7c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294752:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788361127.294754:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361127.294758:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611f7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294763:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611f7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294771:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f83 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294774:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f83 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294777:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f83 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294780:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361127.294787:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f83 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294793:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f83 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294800:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9a8a890c3200) 00010000:00010000:0.0:1788361127.294802:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361127.294805:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f83 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294811:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f83 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294825:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f8a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294831:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f8a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294838:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f8a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294843:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361127.294845:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f8a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294851:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f8a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294857:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:0.0:1788361127.294859:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361127.294868:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f8a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.294873:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f8a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361127.295265:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+24:17334:x1875232130481024:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 1190us (2582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361127.295274:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:1.0:1788361127.300406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361127.300975:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130481280 00000100:00100000:0.0:1788361127.300987:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130481280 00000100:00100000:0.0:1788361127.301134:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:0.0:1788361127.301146:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+24:17334:x1875232130481280:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361127.301170:0:18620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361127.301191:0:18620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e896 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301303:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f98 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301319:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301331:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361127.301342:0:18620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788361127.301444:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f98 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301451:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f98 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301470:0:18620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f98 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301475:0:18620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361127.301479:0:18620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f98 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301505:0:18620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f98 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301518:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:0.0:1788361127.301522:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788361127.301526:0:18620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f98 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301532:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611f98 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301575:0:18620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f91 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e896 expref: 26 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301586:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788361127.301588:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361127.301592:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d6611f91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e896 expref: 26 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.301601:0:18620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965000, rc 0) 00000100:00100000:0.0:1788361127.301784:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+25:17334:x1875232130481280:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 640us (1392us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1788361127.301802:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:2.0:1788361127.310795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361127.310885:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130481408 00000100:00100000:0.0:1788361127.310895:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130481408 00000100:00100000:0.0:1788361127.310958:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:0.0:1788361127.310968:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+25:17334:x1875232130481408:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788361127.311009:0:18652:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788361127.311294:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+25:17334:x1875232130481408:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 327us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361127.311301:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:3.0:1788361127.315271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.315389:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130481664 00000100:00100000:2.0:1788361127.315398:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130481664 00000100:00100000:2.0:1788361127.315457:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:2.0:1788361127.315467:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+25:17334:x1875232130481664:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361127.315491:0:18621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361127.315520:0:18621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611fa6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e89d expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361127.317531:0:18621:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =60 00000004:00080000:2.0:1788361127.317542:0:18621:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+60 in llog 00000004:00080000:2.0:1788361127.317628:0:18621:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788361127.320721:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611fad lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.320767:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611fad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.320781:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611fad lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.320859:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6611fa6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e89d expref: 28 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.320879:0:18621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611fad lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e89d expref: 27 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.320888:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8aa8ee1700) 00010000:00010000:2.0:1788361127.320890:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361127.320894:0:18621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:2.0:1788361127.320975:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+27:17334:x1875232130481664:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 5508us (5711us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788361127.320983:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:1.0:1788361127.325231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361127.325306:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130481920 00000100:00100000:0.0:1788361127.325366:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130481920 00000100:00100000:0.0:1788361127.325458:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1788361127.325470:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+27:17334:x1875232130481920:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361127.325540:0:18619:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361127.325567:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6611fad lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e89d expref: 27 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325585:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8aa8ee1700) 00010000:00010000:0.0:1788361127.325596:0:18619:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361127.325619:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611fbb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325634:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611fbb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325643:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611fbb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325672:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611fc2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe38fd8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325680:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611fc2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe38fd8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325686:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611fc2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe38fd8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325773:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611fbb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325782:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611fbb lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325789:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611fbb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325800:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361127.325804:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611fbb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325812:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611fbb lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325821:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:0.0:1788361127.325824:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361127.325827:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611fbb lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325834:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6611fbb lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325849:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611fc2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe38fd8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325855:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611fc2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe38fd8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325861:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611fc2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe38fd8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325867:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361127.325870:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611fc2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe38fd8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325876:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611fc2 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xe38fd8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325883:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xe38fd8f (ffff9a8a890c3200) 00010000:00010000:0.0:1788361127.325885:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361127.325888:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611fc2 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe38fd8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.325893:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6611fc2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xe38fd8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361127.326017:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+26:17334:x1875232130481920:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 549us (941us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361127.326025:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:3.0:1788361127.329571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361127.329627:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130482048 00000100:00100000:0.0:1788361127.329637:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130482048 00000100:00100000:0.0:1788361127.329703:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:0.0:1788361127.329730:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+26:17334:x1875232130482048:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361127.329750:0:18620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361127.329782:0:18620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611fc9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e8a4 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.329817:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6611fd0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.329830:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6611fd0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.329841:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6611fd0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.329935:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6611fc9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8a4 expref: 28 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.329952:0:18620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6611fd0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8a4 expref: 27 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.329960:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:0.0:1788361127.329963:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361127.329966:0:18620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965600, rc 0) 00000100:00100000:0.0:1788361127.330388:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+27:17334:x1875232130482048:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 659us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361127.330397:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:3.0:1788361127.332681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.332764:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130482304 00000100:00100000:2.0:1788361127.332780:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130482304 00000100:00100000:2.0:1788361127.332833:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:2.0:1788361127.332843:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+27:17334:x1875232130482304:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361127.332919:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fd7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.332934:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fd7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.332961:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fd7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361127.333431:0:18652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:2.0:1788361127.333441:0:18652:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 517348354862ns, next at 518348352375ns, rc = 0 00000004:00010000:2.0:1788361127.333538:0:18652:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099949333 reply state 00000000098a7201 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fd7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361127.333548:0:18652:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361127.333643:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+29:17334:x1875232130482304:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 799us (965us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1788361127.333652:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:3.0:1788361127.336189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361127.336662:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130482432 00000100:00100000:1.0:1788361127.336672:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130482432 00000100:00100000:1.0:1788361127.336735:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:1.0:1788361127.336745:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+29:17334:x1875232130482432:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361127.336869:0:18621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361127.336890:0:18621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6611fde lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e8ab expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.336945:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6611fde lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8ab expref: 30 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.336959:0:18621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6611fde lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8ab expref: 30 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.336977:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:1.0:1788361127.336981:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361127.336985:0:18621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca400, rc 0) 00000100:00100000:1.0:1788361127.337051:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+30:17334:x1875232130482432:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 307us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361127.337058:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00010000:00010000:0.0:1788361127.339026:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fd7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.339059:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fd7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.339065:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fd7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.339072:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361127.339076:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fd7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.339098:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fd7 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.339116:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:0.0:1788361127.339119:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788361127.339123:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fd7 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.339129:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fd7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361127.339482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361127.339568:0:20647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130482560 00000100:00100000:0.0:1788361127.339580:0:20647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130482560 00000100:00100000:0.0:1788361127.339672:0:20647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:0.0:1788361127.339682:0:20647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+5:2349:x1875232130482560:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788361127.339700:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361127.340030:0:20647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2349:x1875232130482560:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 350us (551us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788361127.340038:0:20647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361127.342913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361127.343242:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130482816 00000100:00100000:0.0:1788361127.343263:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130482816 00000100:00100000:2.0:1788361127.343360:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361127.343373:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+29:17334:x1875232130482816:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788361127.343616:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+30:17334:x1875232130482816:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 245us (709us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788361127.343624:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361127.347034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.347193:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130483072 00000100:00100000:2.0:1788361127.347206:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130483072 00000100:00100000:2.0:1788361127.347271:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:2.0:1788361127.347281:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+30:17334:x1875232130483072:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788361127.347682:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+30:17334:x1875232130483072:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 400us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361127.347707:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:0.0:1788361127.353756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.353848:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130483200 00000100:00100000:2.0:1788361127.353858:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130483200 00000100:00100000:2.0:1788361127.353917:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:2.0:1788361127.353927:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+30:17334:x1875232130483200:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361127.353948:0:18620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361127.353968:0:18620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611fe5 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e8b2 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.354040:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.354054:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.354065:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361127.354147:0:18620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361127.354167:0:18620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.354191:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611fe5 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b2 expref: 32 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.354208:0:18620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b2 expref: 31 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.354217:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:2.0:1788361127.354235:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788361127.354239:0:18620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e600, rc 0) 00000100:00100000:2.0:1788361127.354300:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+31:17334:x1875232130483200:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 374us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361127.354308:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:1.0:1788361127.357826:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.357916:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130483328 00000100:00100000:2.0:1788361127.357926:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130483328 00000100:00100000:2.0:1788361127.357985:0:19254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361127.357995:0:19254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2350:x1875232130483328:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361127.358013:0:19254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361127.358034:0:19254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac421c52/0xf6a94c97d6611ff3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e8b9 expref: -99 pid: 19254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361127.358062:0:19254:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9839a8, blocks: 0x1 00010000:00010000:2.0:1788361127.358115:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=517s v=(0 0) 00010000:00010000:2.0:1788361127.358194:0:19254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361127.358206:0:19254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac421c52/0xf6a94c97d6611ff3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b9 expref: 7 pid: 19254 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.358225:0:19254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ac421c52/0xf6a94c97d6611ff3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b9 expref: 7 pid: 19254 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.358238:0:19254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:2.0:1788361127.358295:0:19254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+7:2350:x1875232130483328:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 301us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361127.358303:0:19254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361127.362937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.363034:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130483584 00000100:00100000:2.0:1788361127.363045:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130483584 00000100:00100000:2.0:1788361127.363145:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:2.0:1788361127.363155:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+31:17334:x1875232130483584:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788361127.363261:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+31:17334:x1875232130483584:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 107us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361127.363268:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:1.0:1788361127.367174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.367236:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130483712 00000100:00100000:2.0:1788361127.367247:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130483712 00000100:00100000:2.0:1788361127.367306:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:2.0:1788361127.367315:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+31:17334:x1875232130483712:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788361127.407257:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901907 is committed 00000001:00080000:3.0:1788361127.407291:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:3.0:1788361127.407303:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1788361127.407310:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788361127.407516:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361127.407535:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144089216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788361127.407602:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361127.407681:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144089216 00000100:00100000:1.0:1788361127.407688:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144089216 00000100:00100000:1.0:1788361127.407729:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788361127.407738:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144089216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788361127.407908:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788361127.407911:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788361127.407913:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361127.407915:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788361128 -> 1788361128 00002000:00010000:1.0:1788361127.407918:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788361127.407957:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144089216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (356us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788361127.407965:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1788361127.408002:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8ab710fb80/2, rc 0, transno 12884901891 00000100:00100000:1.0:1788361127.408008:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144089216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788361127.408401:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+14:17334:x1875232130483712:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 41083us (41234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361127.408409:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:1.0:1788361127.411344:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.411446:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130483840 00000100:00100000:2.0:1788361127.411455:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130483840 00000100:00100000:2.0:1788361127.411548:0:19254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788361127.411559:0:19254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+7:2349:x1875232130483840:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788361127.411667:0:19254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+7:2349:x1875232130483840:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 111us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361127.411675:0:19254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:3.0:1788361127.416283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.416613:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130484096 00000100:00100000:2.0:1788361127.416623:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130484096 00000100:00100000:2.0:1788361127.416730:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:2.0:1788361127.416741:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+14:17334:x1875232130484096:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361127.416888:0:18652:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361127.416915:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6611fec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b2 expref: 14 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.416935:0:18652:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:2.0:1788361127.416940:0:18652:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361127.416973:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611ffa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.416988:0:18652:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611ffa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.416997:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611ffa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361127.417214:0:18652:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3571a0c reply state 0000000057788571 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611ffa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361127.417221:0:18652:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361127.417437:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+15:17334:x1875232130484096:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 696us (1162us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788361127.417444:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00010000:00010000:3.0:1788361127.420633:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611ffa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.420650:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611ffa lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.420658:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611ffa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.420664:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361127.420669:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611ffa lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.420694:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611ffa lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.420710:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:3.0:1788361127.420713:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361127.420722:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611ffa lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.420729:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6611ffa lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18652 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.420817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.420972:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130484224 00000100:00100000:2.0:1788361127.420984:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130484224 00000100:00100000:2.0:1788361127.421046:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1788361127.421055:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+7:2350:x1875232130484224:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788361127.421893:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788361127.421898:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1788361127 00002000:00010000:2.0:1788361127.421901:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb atime from disk: 0 -> 1788361127 00002000:00010000:2.0:1788361127.421912:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788361128 -> 1788361127 00002000:00010000:2.0:1788361127.421926:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788361127.421990:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+8:2350:x1875232130484224:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 935us (1176us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788361127.421999:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361127.425942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361127.426012:0:19253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130484352 00000100:00100000:1.0:1788361127.426022:0:19253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130484352 00000100:00100000:1.0:1788361127.426120:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1788361127.426132:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+8:2349:x1875232130484352:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788361127.426176:0:19253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d6612001 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.426195:0:19253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361127.426200:0:19253:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361127.426206:0:19253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d6612001 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.426240:0:19253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d6612001 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.426271:0:19253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d6612001 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.426280:0:19253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d6612001 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.426290:0:19253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d6612001 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.426298:0:19253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361127.426302:0:19253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d6612001 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.426312:0:19253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d6612001 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.426328:0:19253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d6612001 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.426335:0:19253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d6612001 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.426417:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+8:2349:x1875232130484352:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 286us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361127.426425:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361127.427827:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361127.427903:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130484608 00000100:00100000:1.0:1788361127.427910:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130484608 00000100:00100000:1.0:1788361127.428010:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:1.0:1788361127.428020:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+14:17334:x1875232130484608:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788361127.428126:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6612008 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.428141:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6612008 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.428151:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6612008 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.428379:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.428391:0:18621:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6611fde lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8ab expref: 15 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.428404:0:18621:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.428438:0:18621:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6611fde lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8ab expref: 15 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.428463:0:18621:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6611fde lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8ab expref: 15 pid: 18621 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.428477:0:18621:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18621:1875232144089344:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361127.428575:0:18621:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a850819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361127.431710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361127.431799:0:18621:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18621:1875232144089344:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361127.431808:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130484736 00000100:00100000:2.0:1788361127.431814:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130484736 00010000:00010000:1.0:1788361127.431821:0:18621:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.431850:0:18605:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6611fde lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8ab expref: 16 pid: 18621 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361127.431885:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361127.431894:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+16:2349:x1875232130484736:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361127.431910:0:18605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361127.431917:0:18605:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6611fde lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8ab expref: 16 pid: 18621 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.431929:0:18605:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6611fde lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8ab expref: 16 pid: 18621 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.431950:0:18605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6611fde lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8ab expref: 16 pid: 18621 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.431965:0:18605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:2.0:1788361127.431970:0:18605:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.431979:0:18605:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.432003:0:18605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.432036:0:18605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361127.432112:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+15:2349:x1875232130484736:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 191us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361127.432121:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00010000:00010000:1.0:1788361127.432131:0:18621:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.432139:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361127.432328:0:18621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1788361127.432460:0:18621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1788361127.432513:0:18621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1788361127.432585:0:18621:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18621:1875232144089472:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788361127.432671:0:18621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361127.432706:0:18621:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a909359c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361127.432976:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144089472 00000100:00100000:2.0:1788361127.432982:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144089472 00000100:00100000:2.0:1788361127.433019:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361127.433026:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18621:x1875232144089472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361127.433124:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18621:x1875232144089472:12345-0@lo:1000:mdt00_002.0 Request processed in 98us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361127.433130:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361127.433368:0:18621:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18621:1875232144089472:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788361127.434327:0:18621:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1788361127.434397:0:18621:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18621:1875232144089600:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788361127.434431:0:18621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361127.434453:0:18621:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a829ecd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361127.434526:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144089600 00000100:00100000:3.0:1788361127.434533:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144089600 00000100:00100000:3.0:1788361127.434581:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361127.434591:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:18621:x1875232144089600:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361127.435014:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:18621:x1875232144089600:12345-0@lo:1000:mdt00_002.0 Request processed in 425us (581us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788361127.435022:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361127.435317:0:18621:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:18621:1875232144089600:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788361127.435350:0:18621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435360:0:18621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435369:0:18621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435375:0:18621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcaa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361127.435379:0:18621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435386:0:18621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435416:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:1.0:1788361127.435419:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361127.435424:0:18621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435430:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661200f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435458:0:18621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435464:0:18621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435469:0:18621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435483:0:18621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361127.435487:0:18621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435493:0:18621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435512:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:1.0:1788361127.435514:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361127.435521:0:18621:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f75 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e88f expref: 18 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435531:0:18621:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f75 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e88f expref: 18 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435539:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f75 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e88f expref: 18 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.435573:0:18621:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6611f75 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e88f expref: 18 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.435584:0:18621:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18621:1875232144089728:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361127.435641:0:18621:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a850819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361127.437908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.437965:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130484864 00000100:00100000:2.0:1788361127.437976:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130484864 00000100:00100000:1.0:1788361127.437990:0:18621:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18621:1875232144089728:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361127.438017:0:18621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361127.438032:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1788361127.438044:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0865c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+19:17333:x1875232130484864:12345-192.168.203.60@tcp:49:dd.0 00010000:00010000:1.0:1788361127.438045:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6611f6e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361127.438197:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0865c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+19:17333:x1875232130484864:12345-192.168.203.60@tcp:49:dd.0 Request processed in 155us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361127.438205:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00010000:00010000:1.0:1788361127.438314:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6612016 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438330:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6612016 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438342:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6612016 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438352:0:18621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6612016 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438358:0:18621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6612016 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438364:0:18621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6612016 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438370:0:18621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361127.438373:0:18621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6612016 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438380:0:18621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6612016 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438391:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:1.0:1788361127.438394:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361127.438397:0:18621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6612016 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438411:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6612016 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438422:0:18621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6612008 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438428:0:18621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6612008 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438444:0:18621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6612008 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438449:0:18621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361127.438452:0:18621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6612008 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438458:0:18621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6612008 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438466:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:1.0:1788361127.438469:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361127.438472:0:18621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6612008 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.438477:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6612008 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.438672:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+18:17334:x1875232130484608:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 10652us (10851us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788361127.438681:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000020:00080000:1.0:1788361127.438691:0:18621:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788361127.438864:0:18654:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788361127.438869:0:18654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361127.438910:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788361127.438917:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788361127.441740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361127.441912:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130485120 00000100:00100000:1.0:1788361127.441923:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130485120 00000100:00100000:1.0:1788361127.441977:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361127.441986:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+18:17334:x1875232130485120:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788361127.442704:0:18622:0:(mdd_object.c:4016:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788361127.442820:0:18622:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:1.0:1788361127.442866:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661201d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.442884:0:18622:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661201d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.442895:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661201d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.442903:0:18622:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661201d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.442910:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661201d lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.442916:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661201d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.442941:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788361127.443040:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+20:17334:x1875232130485120:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1054us (1308us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788361127.443049:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000020:00080000:1.0:1788361127.443055:0:18622:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788361127.443265:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361127.443273:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661201d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.443281:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcaa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361127.443285:0:18607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661201d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.443293:0:18607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661201d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.443308:0:18607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:0.0:1788361127.443311:0:18607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788361127.443316:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661201d lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.443321:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d661201d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18622 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.443334:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361127.443336:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361127.443338:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361127.471143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361127.471259:0:19258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130485248 00000100:00100000:0.0:1788361127.471270:0:19258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130485248 00000100:00100000:0.0:1788361127.471410:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361127.471421:0:19258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+8:2349:x1875232130485248:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:0.0:1788361127.471455:0:19258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.471476:0:19258:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac421c52/0xf6a94c97d6611ff3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b9 expref: 8 pid: 19254 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.471484:0:19258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361127.471489:0:19258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361127.471493:0:19258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.471541:0:19258:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ac421c52/0xf6a94c97d6611ff3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b9 expref: 8 pid: 19254 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.471556:0:19258:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ac421c52/0xf6a94c97d6611ff3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b9 expref: 8 pid: 19254 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361127.471582:0:19258:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:19258:1875232144089856:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361127.471652:0:19258:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8aff8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361127.474721:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.474756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.474800:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.474817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.474829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.474869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.474894:0:19259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788361127.474903:0:19259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1788361127.474997:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130486144 00000100:00100000:3.0:1788361127.475006:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130486144 00010000:00010000:3.0:1788361127.475052:0:18604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ac421c52/0xf6a94c97d6611ff3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b9 expref: 9 pid: 19254 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.475079:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788361127.475115:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361127.475131:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+9:2351:x1875232130486144:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361127.475146:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361127.475168:0:18604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ac421c52/0xf6a94c97d6611ff3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b9 expref: 9 pid: 19254 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.475182:0:18604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ac421c52/0xf6a94c97d6611ff3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b9 expref: 9 pid: 19254 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.475206:0:18604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361127.475210:0:18604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361127.475215:0:18604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.475225:0:18604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.475229:0:19260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130485376 00000100:00100000:1.0:1788361127.475237:0:19260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130485376 00010000:00010000:3.0:1788361127.475247:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361127.475269:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788361127.475277:0:19260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130485632 00000100:00100000:1.0:1788361127.475280:0:19260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130485632 00000100:00100000:1.0:1788361127.475295:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788361127.475296:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+11:2351:x1875232130486144:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 165us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361127.475302:0:19260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130485888 00000100:00100000:1.0:1788361127.475306:0:19260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130485888 00000100:00100000:3.0:1788361127.475308:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361127.475322:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788361127.475328:0:19260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130485504 00000100:00100000:1.0:1788361127.475330:0:19260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130485504 00000100:00100000:1.0:1788361127.475343:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788361127.475348:0:19260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130485760 00000100:00100000:1.0:1788361127.475351:0:19260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130485760 00010000:00010000:0.0:1788361127.476289:0:19258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac421c52/0xf6a94c97d6611ff3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e8b9 expref: 13 pid: 19254 timeout: 617 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361127.476306:0:19258:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:19258:1875232144089856:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361127.476327:0:19258:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.476343:0:19258:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.476351:0:19258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.479339:0:20651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:1.0:1788361127.479355:0:20651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+13:2350:x1875232130485376:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:1.0:1788361127.479395:0:20651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d661202b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.479414:0:20651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361127.479418:0:20651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361127.479424:0:20651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d661202b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.479438:0:20651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d661202b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361127.481054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361127.482407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361127.484507:0:19260:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788361127.485725:0:19259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1788361127.485727:0:19260:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1788361127.485735:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130486016 00000100:00100000:3.0:1788361127.485745:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130486016 00000100:00100000:3.0:1788361127.485808:0:19259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788361127.485813:0:19259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130486272 00000100:00100000:3.0:1788361127.485816:0:19259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130486272 00000100:00100000:3.0:1788361127.487888:0:20652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361127.487907:0:20652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6dc24666-75f2-466e-bd74-ac2809e63d73+16:2350:x1875232130485632:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:3.0:1788361127.488996:0:20652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6612032 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.489017:0:20652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361127.489022:0:20652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361127.489030:0:20652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6612032 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.489045:0:20652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6612032 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361127.567331:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00000001:00080000:0.0:1788361127.567356:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901891 is committed 00000001:00080000:0.0:1788361127.567371:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901893 is committed 00002000:00010000:3.0:1788361127.567432:0:20652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:3.0:1788361127.567436:0:20652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb mtime from disk: 1788361127 -> 1788361128 00002000:00010000:3.0:1788361127.567439:0:20652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb ctime from disk: 1788361127 -> 1788361128 00002000:00010000:3.0:1788361127.567441:0:20652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:3.0:1788361127.567454:0:20652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6612032 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.567468:0:20652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6612032 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.567477:0:20652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6612032 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.567484:0:20652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361127.567489:0:20652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6612032 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.567526:0:20652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6612032 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.567547:0:20652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6612032 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.567614:0:20652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6612032 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361127.567700:0:20652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6dc24666-75f2-466e-bd74-ac2809e63d73+14:2350:x1875232130485632:12345-192.168.203.60@tcp:4:dd.0 Request processed in 79796us (92895us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788361127.567709:0:20652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361127.567738:0:20652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:3.0:1788361127.567751:0:20652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6dc24666-75f2-466e-bd74-ac2809e63d73+13:2350:x1875232130485888:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:2.0:1788361127.567863:0:20651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d661202b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.567873:0:20651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d661202b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.567881:0:20651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d661202b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.567887:0:20651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361127.567891:0:20651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d661202b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.567899:0:20651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d661202b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.567909:0:20651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d661202b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.567916:0:20651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d661202b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.568004:0:20652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d6612039 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.568016:0:20652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361127.568020:0:20652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361127.568026:0:20652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d6612039 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361127.568039:0:20652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d6612039 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361127.568231:0:20651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+13:2350:x1875232130485376:12345-192.168.203.60@tcp:4:dd.0 Request processed in 88880us (93473us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788361127.568244:0:20651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:2.0:1788361127.568259:0:20651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361127.568266:0:20651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+12:2350:x1875232130485504:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:2.0:1788361127.568281:0:20651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6612040 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.568290:0:20651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361127.568293:0:20651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361127.568298:0:20651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6612040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.568307:0:20651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6612040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.569067:0:19258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.569118:0:19258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.569125:0:19258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.569132:0:19258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361127.569135:0:19258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.569144:0:19258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.569157:0:19258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.569164:0:19258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6612024 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.569221:0:19258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+12:2349:x1875232130485248:12345-192.168.203.60@tcp:4:dd.0 Request processed in 97800us (98084us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788361127.569229:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361127.569250:0:19258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788361127.569259:0:19258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+11:2350:x1875232130485760:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:1.0:1788361127.569279:0:19258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6612047 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.569293:0:19258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361127.569297:0:19258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361127.569302:0:19258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6612047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.569312:0:19258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6612047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361127.623600:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901897 is committed 00002000:00010000:1.0:1788361127.626782:0:20652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:1.0:1788361127.626792:0:20652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 6151 -> 12295 00010000:00010000:1.0:1788361127.626808:0:20652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d6612039 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.626822:0:20652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d6612039 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.626831:0:20652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d6612039 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.626838:0:20652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361127.626843:0:20652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d6612039 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.626852:0:20652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d6612039 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.626886:0:20652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d6612039 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.626895:0:20652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d6612039 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.626991:0:20652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6dc24666-75f2-466e-bd74-ac2809e63d73+15:2350:x1875232130485888:12345-192.168.203.60@tcp:4:dd.0 Request processed in 59240us (152168us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788361127.627002:0:20652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1788361127.627036:0:20652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361127.627047:0:20652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6dc24666-75f2-466e-bd74-ac2809e63d73+14:2349:x1875232130486016:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:1.0:1788361127.627080:0:20652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661204e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.627133:0:20652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361127.627138:0:20652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361127.627144:0:20652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661204e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.627156:0:20652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661204e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361127.659236:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901899 is committed 00002000:00010000:1.0:1788361127.659277:0:20651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:1.0:1788361127.659293:0:20651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6612040 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.659324:0:20651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6612040 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.659331:0:20651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6612040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.659339:0:20651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361127.659343:0:20651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6612040 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.659353:0:20651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6612040 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.659372:0:20651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6612040 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.659380:0:20651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6612040 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.659639:0:19258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6612047 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.659649:0:19258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6612047 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.659657:0:19258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6612047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.659663:0:19258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361127.659665:0:19258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6612047 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.659673:0:20651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+12:2350:x1875232130485504:12345-192.168.203.60@tcp:4:dd.0 Request processed in 91402us (184837us total) trans 12884901898 rc 0/0 00010000:00010000:0.0:1788361127.659673:0:19258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6612047 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.659684:0:20651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00010000:00010000:0.0:1788361127.659685:0:19258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6612047 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361127.659697:0:19258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6612047 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361127.659714:0:20651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361127.659724:0:20651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+10:2350:x1875232130486272:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361127.659727:0:19258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+10:2350:x1875232130485760:12345-192.168.203.60@tcp:4:dd.0 Request processed in 90471us (184858us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1788361127.659733:0:19258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00010000:00010000:1.0:1788361127.659755:0:20651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6612055 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.659774:0:20651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361127.659779:0:20651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361127.659786:0:20651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6612055 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361127.659797:0:20651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6612055 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361127.694483:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901900 is committed 00002000:00010000:2.0:1788361127.694604:0:20652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788361127.694609:0:20652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1788361127.694621:0:20652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661204e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.694635:0:20652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661204e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.694645:0:20652:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661204e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.694662:0:20652:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361127.694667:0:20652:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661204e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.694676:0:20652:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661204e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.694701:0:20652:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661204e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.694709:0:20652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661204e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361127.694953:0:20652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6dc24666-75f2-466e-bd74-ac2809e63d73+9:2349:x1875232130486016:12345-192.168.203.60@tcp:4:dd.0 Request processed in 67903us (213899us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788361127.694963:0:20652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000001:00080000:0.0:1788361127.724922:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901901 is committed 00002000:00010000:2.0:1788361127.725305:0:20651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x42:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1788361127.725321:0:20651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6612055 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.725335:0:20651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6612055 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.725344:0:20651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6612055 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.725367:0:20651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361127.725372:0:20651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6612055 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.725381:0:20651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6612055 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.725402:0:20651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6612055 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361127.725409:0:20651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6612055 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361127.725513:0:20651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+5:2350:x1875232130486272:12345-192.168.203.60@tcp:4:dd.0 Request processed in 65785us (243104us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788361127.725526:0:20651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:0.0:1788361127.968426:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361128.096436:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144089984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361128.096518:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361128.096659:0:19256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144089984 00000100:00100000:1.0:1788361128.096667:0:19256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144089984 00000100:00100000:1.0:1788361128.096714:0:19256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788361128.096722:0:19256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144089984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361128.096745:0:19256:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1788361128.096799:0:19256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144089984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361128.096806:0:19256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788361128.096937:0:3312:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:2.0:1788361128.096943:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8ab710fb80, transno 12884901891 00000004:00080000:2.0:1788361128.096960:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:2.0:1788361128.096986:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144089984:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788361128.979589:0:20690:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788361128.996987:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361130.017341:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 9290 lines, 9290 kept, 0 dropped, 0 bad.