00000100:00100000:1.0F:1788839876.778175:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839876.778295:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0F:1788839876.778547:0:18626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050256256 00000100:00100000:0.0:1788839876.778562:0:18626:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050256256 00002000:00100000:0.0:1788839876.778623:0:18626:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff8ab7819b1880 x1875734050256256/t0(0) o4->fb9a0095-2d97-404b-912c-8b552d60d900@192.168.203.52@tcp:267/0 lens 504/0 e 0 to 0 dl 1788839887 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788839876.778634:0:18626:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab7819b1880 with x1875734050256256 ext(0->8) 00002000:00010000:0.0:1788839876.778639:0:18626:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab7819b1880 00000100:00100000:0.0:1788839876.778667:0:18626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788839876.778676:0:18626:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb9a0095-2d97-404b-912c-8b552d60d900+8:2390:x1875734050256256:12345-192.168.203.52@tcp:4:bash.0 00000100:00080000:1.0:1788839876.778750:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0F:1788839876.779395:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050256384 00000100:00100000:3.0:1788839876.779408:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050256384 00000100:00100000:3.0:1788839876.779457:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1788839876.779466:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+11:2390:x1875734050256384:12345-192.168.203.52@tcp:16:kworker.0 00000100:00100000:1.0:1788839876.779890:0:18626:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb9a0095-2d97-404b-912c-8b552d60d900+11:2390:x1875734050256256:12345-192.168.203.52@tcp:4:bash.0 Request processed in 1213us (1593us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788839876.779905:0:18626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:1.0:1788839876.779913:0:18626:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x22:0x0] (0->8) req@ffff8ab7819b1880 x1875734050256256/t8589934599(0) o4->fb9a0095-2d97-404b-912c-8b552d60d900@192.168.203.52@tcp:267/0 lens 504/448 e 0 to 0 dl 1788839887 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788839876.779922:0:18626:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab7819b1880 with x1875734050256256 ext(0->8) 00002000:00010000:1.0:1788839876.779927:0:18626:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab7819b1880 00000001:00080000:1.0:1788839876.788544:0:18617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1788839876.788567:0:18617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000100:00100000:0.0:1788839876.788813:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+6:2390:x1875734050256384:12345-192.168.203.52@tcp:16:kworker.0 Request processed in 9342us (10641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839876.788825:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00010000:00010000:0.0:1788839877.055967:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839878.016570:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060810752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839878.016646:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839878.017838:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060810752 00000100:00100000:0.0:1788839878.017849:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060810752 00000100:00100000:0.0:1788839878.017939:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839878.017948:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060810752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839878.017969:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 0 free 3923513344 avail 3691962368 00000100:00100000:0.0:1788839878.018020:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060810752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839878.018027:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839878.018070:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060810752:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788839878.018110:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788839878.079856:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839878.464562:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0F:1788839878.465083:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050256512 00000100:00100000:2.0:1788839878.465105:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050256512 00000100:00100000:2.0:1788839878.465174:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:2.0:1788839878.465186:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+25:15590:x1875734050256512:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788839878.465286:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+25:15590:x1875734050256512:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 103us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839878.465295:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00080000:3.0:1788839878.468099:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839878.476188:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839878.476226:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050256640 00000100:00100000:0.0:1788839878.476235:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050256640 00000100:00100000:0.0:1788839878.476293:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:0.0:1788839878.476311:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+5:15590:x1875734050256640:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788839878.476413:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+5:15590:x1875734050256640:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 103us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839878.476422:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00080000:0.0:1788839878.476441:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839878.482831:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839878.482877:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050256896 00000100:00100000:2.0:1788839878.482888:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050256896 00000100:00100000:2.0:1788839878.482962:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788839878.482973:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7750cbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb9a0095-2d97-404b-912c-8b552d60d900+25:15590:x1875734050256896:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788839878.483490:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7750cbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb9a0095-2d97-404b-912c-8b552d60d900+26:15590:x1875734050256896:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 506us (656us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788839878.483499:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788839879.038988:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060810880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839879.039064:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839879.039217:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060810880 00000100:00100000:2.0:1788839879.039224:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060810880 00000100:00100000:2.0:1788839879.039275:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788839879.039284:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060810880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788839879.039317:0:17119:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788839879.039359:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060810880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839879.039366:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788839879.039446:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060810880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839879.039572:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060811008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839879.039599:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839879.041166:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060811008 00000100:00100000:0.0:1788839879.041176:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060811008 00000100:00100000:0.0:1788839879.041229:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788839879.041238:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060811008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839879.041266:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788839879.041330:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060811008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839879.041338:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788839879.041376:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060811008:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788839879.042896:0:17093:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:0.0:1788839879.042920:0:17093:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab744455a80 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1788839879.042925:0:17093:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab781931100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab7444550c0 00000020:00080000:0.0:1788839879.042928:0:17093:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab781931d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab647bd1800 00000020:00080000:3.0:1788839879.043035:0:17153:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1788839879.043098:0:17153:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788839879.043180:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839879.043192:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839879.043200:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839879.043205:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839879.043210:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839879.043218:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839879.043234:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:1.0:1788839879.043237:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839879.043252:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839879.043259:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839879.103805:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839879.104016:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788839879.856212:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839879.856306:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839879.856344:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839879.856381:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839879.856422:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050257408 00000100:00100000:0.0:1788839879.856434:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050257408 00000100:00100000:1.0:1788839879.856487:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050257280 00000100:00100000:1.0:1788839879.856494:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050257280 00000100:00100000:1.0:1788839879.856539:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050257152 00000100:00100000:1.0:1788839879.856543:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050257152 00000100:00100000:0.0:1788839879.856564:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788839879.856574:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:0.0:1788839879.856576:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb9a0095-2d97-404b-912c-8b552d60d900+6:2389:x1875734050257408:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839879.856588:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+5:2389:x1875734050257280:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839879.856644:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050257024 00000100:00100000:2.0:1788839879.856647:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050257024 00000100:00100000:1.0:1788839879.856658:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+5:2389:x1875734050257280:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 73us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839879.856668:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1788839879.856679:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:3.0:1788839879.856682:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1788839879.856688:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+13:2389:x1875734050257024:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839879.856699:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+12:2389:x1875734050257152:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:1.0:1788839879.856722:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839879.856823:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb9a0095-2d97-404b-912c-8b552d60d900+6:2389:x1875734050257408:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 251us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839879.856829:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:2.0:1788839879.856909:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+13:2389:x1875734050257024:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 223us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839879.856919:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:3.0:1788839879.871951:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+12:2389:x1875734050257152:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 15246us (15593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839879.871965:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:0.0:1788839879.872351:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839879.872405:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050257536 00000100:00100000:2.0:1788839879.872416:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050257536 00000100:00100000:0.0:1788839879.872436:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839879.872492:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1788839879.872503:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+5:2388:x1875734050257536:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:2.0:1788839879.872534:0:19203:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657415d 00000100:00080000:2.0:1788839879.872546:0:19203:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788839879.872585:0:19203:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788839879.872690:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+2:2388:x1875734050257536:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 189us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839879.872695:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00010000:00010000:2.0:1788839879.872721:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839879.872806:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050257664 00000100:00100000:2.0:1788839879.872811:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050257664 00000100:00100000:2.0:1788839879.872843:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1788839879.872854:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2389:x1875734050257664:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839879.872858:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839879.872900:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2389:x1875734050257664:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 50us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839879.872908:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1788839879.872919:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050257792 00000100:00100000:2.0:1788839879.872923:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050257792 00000100:00100000:2.0:1788839879.872945:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:2.0:1788839879.872953:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2390:x1875734050257792:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:3.0:1788839879.873148:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788839879.873154:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839879.873156:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839879.880378:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2390:x1875734050257792:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 7415us (7514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839879.880409:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:0.0:1788839879.881940:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839879.882005:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839879.882121:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050257920 00000100:00100000:3.0:1788839879.882126:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050258048 00000100:00100000:1.0:1788839879.882132:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050257920 00000100:00100000:3.0:1788839879.882134:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050258048 00000100:00100000:3.0:1788839879.882201:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788839879.882212:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2388:x1875734050258048:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1788839879.882261:0:18622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657419c 00000100:00080000:3.0:1788839879.882270:0:18622:0:(import.c:65:import_set_state_nolock()) ffff8ab647a00000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839879.882312:0:18622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:2.0:1788839879.882360:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839879.882446:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+2:2388:x1875734050258048:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 236us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839879.882455:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:1.0:1788839879.882693:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:1.0:1788839879.882701:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2388:x1875734050257920:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:1.0:1788839879.882714:0:18620:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26574195 00000100:00080000:1.0:1788839879.882725:0:18620:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788839879.882757:0:18620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788839879.882865:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+2:2388:x1875734050257920:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 165us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839879.882872:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00010000:00010000:1.0:1788839879.882916:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788839879.883105:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839879.883110:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839880.063264:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060811136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839880.063330:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839880.063450:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060811136 00000100:00100000:0.0:1788839880.063458:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060811136 00000100:00100000:0.0:1788839880.063534:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839880.063545:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060811136:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839880.063565:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060811264:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839880.063586:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788839880.063596:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839880.063619:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839880.063626:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060811392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839880.063643:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060811136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839880.063654:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839880.063654:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839880.063677:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060811264 00000100:00100000:0.0:1788839880.063681:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060811264 00000100:00100000:0.0:1788839880.063700:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060811392 00000100:00100000:0.0:1788839880.063703:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060811392 00000100:00100000:3.0:1788839880.063714:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788839880.063724:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060811264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839880.063741:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00080000:2.0:1788839880.063796:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839880.063801:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060811264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00080000:2.0:1788839880.063801:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839880.063820:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060811520:0@lo:400:kworker.0 00000100:00100000:1.0:1788839880.063872:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060811904:0@lo:400:kworker.0 00000100:00100000:0.0:1788839880.063872:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060811648:0@lo:400:kworker.0 00000100:00100000:0.0:1788839880.063900:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839880.063921:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060811648 00000100:00100000:1.0:1788839880.063925:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060811648 00000100:00100000:0.0:1788839880.063930:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060812160:0@lo:400:kworker.0 00000100:00100000:1.0:1788839880.063961:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788839880.063968:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060811648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839880.064002:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060811648:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839880.064008:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788839880.064025:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839880.064043:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060812416:0@lo:400:kworker.0 00000100:00100000:2.0:1788839880.064044:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839880.064064:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839880.064068:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060812032:0@lo:400:kworker.0 00000100:00100000:1.0:1788839880.064080:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788839880.064085:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060811776:0@lo:400:kworker.0 00000100:00100000:2.0:1788839880.064090:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839880.064103:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839880.064105:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060812544:0@lo:400:kworker.0 00000100:00100000:1.0:1788839880.064117:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060812288:0@lo:400:kworker.0 00000100:00100000:2.0:1788839880.064122:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839880.064134:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839880.064148:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060811520 00000100:00100000:2.0:1788839880.064151:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060811520 00000100:00100000:1.0:1788839880.064154:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060812416 00000100:00100000:1.0:1788839880.064156:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060812416 00000100:00100000:2.0:1788839880.064175:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788839880.064177:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060811776 00000100:00100000:1.0:1788839880.064179:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060811776 00000100:00100000:2.0:1788839880.064181:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3616:x1875734060811520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839880.064189:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060812544 00000100:00100000:1.0:1788839880.064191:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060812544 00000100:00100000:1.0:1788839880.064201:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060812288 00000100:00100000:1.0:1788839880.064203:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060812288 00000100:00100000:2.0:1788839880.064211:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3616:x1875734060811520:12345-0@lo:400:kworker.0 Request processed in 31us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839880.064217:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788839880.064217:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788839880.064222:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060812416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839880.064244:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060812032 00000100:00100000:2.0:1788839880.064247:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060812032 00000100:00100000:1.0:1788839880.064252:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060812416:12345-0@lo:400:kworker.0 Request processed in 30us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839880.064258:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788839880.064270:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788839880.064274:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788839880.064275:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060812032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839880.064278:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060811776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839880.064301:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060812032:12345-0@lo:400:kworker.0 Request processed in 25us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839880.064301:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060811776:12345-0@lo:400:kworker.0 Request processed in 22us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839880.064307:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788839880.064315:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788839880.064317:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788839880.064322:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060812544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839880.064373:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060812032:0@lo:400:kworker.0 00000100:00100000:3.0:1788839880.065379:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788839880.065413:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788839880.065414:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060812544:12345-0@lo:400:kworker.0 Request processed in 1087us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839880.065425:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060811392:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839880.065446:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00002000:00000024:3.0:1788839880.065450:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788839880.065475:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788839880.065485:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060812288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839880.065505:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060811392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839880.065512:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788839880.065532:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060812288:12345-0@lo:400:kworker.0 Request processed in 50us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839880.065540:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788839880.065565:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060811904 00000100:00100000:3.0:1788839880.065570:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060811392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839880.065573:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060811904 00000100:00100000:3.0:1788839880.065584:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788839880.065600:0:3614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab641aeed80, transno 8589934596 00000100:00100000:1.0:1788839880.065606:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000004:00080000:3.0:1788839880.065615:0:3614:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1788839880.065616:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060811904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839880.065645:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060811264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839880.065658:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060811904:12345-0@lo:400:kworker.0 Request processed in 43us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839880.065658:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839880.065664:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788839880.065677:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060812160 00000100:00100000:3.0:1788839880.065683:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060812160 00000100:00100000:0.0:1788839880.065688:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060812672:0@lo:400:kworker.0 00000100:00100000:1.0:1788839880.065716:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060811776:0@lo:400:kworker.0 00000100:00100000:3.0:1788839880.065720:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788839880.065721:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839880.065733:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060812160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839880.065733:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060812288:0@lo:400:kworker.0 00000100:00100000:1.0:1788839880.065749:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060811904:0@lo:400:kworker.0 00000100:00100000:0.0:1788839880.065755:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060811136:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788839880.065796:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b2680 x1875734060812416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839880.065799:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060811648:0@lo:400:kworker.0 00000100:00100000:3.0:1788839880.065805:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060812160:12345-0@lo:400:kworker.0 Request processed in 72us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839880.065812:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060812416:0@lo:400:kworker.0 00000100:00100000:0.0:1788839880.065812:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060812160:0@lo:400:kworker.0 00000100:00100000:3.0:1788839880.065818:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788839880.065837:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060812672 00000100:00100000:3.0:1788839880.065841:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060812672 00000100:00080000:1.0:1788839880.065877:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839880.065882:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839880.065884:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839880.066001:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788839880.066012:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060812672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839880.066040:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060811520:0@lo:400:kworker.0 00000100:00100000:3.0:1788839880.066064:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060812672:12345-0@lo:400:kworker.0 Request processed in 53us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839880.066068:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060812544:0@lo:400:kworker.0 00010000:00080000:1.0:1788839880.066888:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b3480 x1875734060812672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839880.066899:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060812672:0@lo:400:kworker.0 00000100:00100000:3.0:1788839880.067819:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:2.0:1788839880.127877:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839881.152190:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839882.176286:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839882.340735:0:20490:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 23:58:00 (1788839880) 00000100:00100000:1.0:1788839883.136490:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839883.136513:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060812800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839883.136578:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839883.137116:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060812800 00000100:00100000:0.0:1788839883.137125:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060812800 00000100:00100000:0.0:1788839883.137181:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788839883.137191:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060812800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839883.137219:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788839883.137266:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060812800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839883.137273:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788839883.137580:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839883.137623:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060812800:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788839883.199402:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839884.158987:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060812928:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839884.159058:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839884.159137:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060812928 00000100:00100000:0.0:1788839884.159145:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060812928 00000100:00100000:0.0:1788839884.159190:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788839884.159199:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060812928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839884.159231:0:17119:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788839884.159274:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060812928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839884.159281:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788839884.159350:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060812928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839884.173625:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060813056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839884.173709:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839884.175569:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060813056 00000100:00100000:0.0:1788839884.175582:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060813056 00000100:00100000:0.0:1788839884.175631:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788839884.175640:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060813056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839884.175675:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788839884.183593:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060813056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7944us (9875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839884.183607:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788839884.186682:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060813056:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788839884.223950:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839884.969755:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839884.969825:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839884.969846:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839884.969862:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839884.969883:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839884.969903:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839884.969930:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050258432 00000100:00100000:0.0:1788839884.969939:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050258432 00000100:00100000:0.0:1788839884.969987:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050258688 00000100:00100000:0.0:1788839884.969990:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050258688 00000100:00100000:0.0:1788839884.970003:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050258304 00000100:00100000:0.0:1788839884.970005:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050258304 00000100:00100000:0.0:1788839884.970015:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050258816 00000100:00100000:0.0:1788839884.970017:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050258816 00000100:00100000:0.0:1788839884.970032:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1788839884.970041:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+5:2389:x1875734050258432:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839884.970109:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+5:2389:x1875734050258432:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839884.970117:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1788839884.970149:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:0.0:1788839884.970155:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2389:x1875734050258688:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839884.970181:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2389:x1875734050258688:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839884.970187:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:0.0:1788839884.970198:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:0.0:1788839884.970203:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+12:2389:x1875734050258304:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839884.970224:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+12:2389:x1875734050258304:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 21us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839884.970230:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:0.0:1788839884.970241:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:0.0:1788839884.970247:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2389:x1875734050258816:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839884.970269:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2389:x1875734050258816:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839884.970274:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:2.0:1788839884.970503:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050258176 00000100:00100000:2.0:1788839884.970509:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050258176 00000100:00100000:2.0:1788839884.970552:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:2.0:1788839884.970558:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+13:2389:x1875734050258176:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839884.971008:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050258560 00000100:00100000:1.0:1788839884.971013:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050258560 00000100:00100000:1.0:1788839884.971055:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:1.0:1788839884.971064:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb9a0095-2d97-404b-912c-8b552d60d900+6:2389:x1875734050258560:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:3.0:1788839884.971244:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839884.971249:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839884.971251:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839884.973682:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+13:2389:x1875734050258176:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 3112us (3926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839884.973697:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:1.0:1788839884.977174:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb9a0095-2d97-404b-912c-8b552d60d900+6:2389:x1875734050258560:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 6099us (7277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839884.977189:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788839885.182994:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839885.183020:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060813184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839885.183095:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839885.183218:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060813696:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.183253:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839885.183316:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060814208:0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.183321:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060813312:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.183339:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839885.183358:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060814720:0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.183378:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839885.183388:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839885.183416:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788839885.183417:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060813824:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.183425:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060813568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839885.183459:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839885.183478:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060813696 00000100:00100000:0.0:1788839885.183483:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060814336:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.183485:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060813696 00000100:00100000:0.0:1788839885.183511:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839885.183531:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060814848:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.183542:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060814208 00000100:00100000:1.0:1788839885.183547:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060814208 00000100:00100000:0.0:1788839885.183555:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839885.183564:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060813824 00000100:00100000:1.0:1788839885.183568:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060813824 00000100:00100000:1.0:1788839885.183584:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060814336 00000100:00100000:1.0:1788839885.183587:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060814336 00000100:00100000:0.0:1788839885.183588:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788839885.183596:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060813440:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.183607:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788839885.183617:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060813696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.183624:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839885.183642:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060813952:0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.183664:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839885.183692:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060814464:0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.183710:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839885.183724:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060814976:0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.183743:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839885.183831:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060813312 00000100:00100000:0.0:1788839885.183836:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060813312 00000100:00100000:0.0:1788839885.183862:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788839885.183870:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060813312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.183903:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060813312:12345-0@lo:400:kworker.0 Request processed in 34us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839885.183910:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788839885.183940:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839885.183947:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060814208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.183975:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060814208:12345-0@lo:400:kworker.0 Request processed in 29us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839885.183982:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839885.183995:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788839885.184002:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060813824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.184032:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060813696:12345-0@lo:400:kworker.0 Request processed in 414us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839885.184039:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060813824:12345-0@lo:400:kworker.0 Request processed in 36us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839885.184045:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788839885.184059:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788839885.184066:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788839885.184075:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060814336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.184082:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060813440 00000100:00100000:0.0:1788839885.184087:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060813440 00000100:00100000:0.0:1788839885.184112:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788839885.184119:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060813440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.184149:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060813440:12345-0@lo:400:kworker.0 Request processed in 31us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839885.184155:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788839885.184176:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060814720 00000100:00100000:0.0:1788839885.184179:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060814720 00000100:00100000:1.0:1788839885.184186:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060814336:12345-0@lo:400:kworker.0 Request processed in 111us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839885.184195:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788839885.184199:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060814848 00000100:00100000:0.0:1788839885.184203:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060814848 00000100:00100000:0.0:1788839885.184219:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060813952 00000100:00100000:0.0:1788839885.184222:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060813952 00000100:00100000:1.0:1788839885.184223:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060814464 00000100:00100000:1.0:1788839885.184229:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060814464 00000100:00100000:0.0:1788839885.184236:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060814976 00000100:00100000:0.0:1788839885.184240:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060814976 00000100:00100000:1.0:1788839885.184255:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788839885.184362:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060813184 00000100:00100000:3.0:1788839885.184365:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060813184 00000100:00100000:3.0:1788839885.184388:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788839885.184394:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060813184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788839885.184413:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788839885.184459:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060813184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (1365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839885.184467:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839885.184473:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788839885.184482:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060814848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839885.184491:0:17149:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788839885.184499:0:17149:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788839885.184520:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060814848:12345-0@lo:400:kworker.0 Request processed in 40us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839885.184526:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788839885.184540:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788839885.184546:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060813952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.184573:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060813952:12345-0@lo:400:kworker.0 Request processed in 27us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839885.184579:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788839885.184591:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788839885.184606:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060814464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839885.184654:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060814464:12345-0@lo:400:kworker.0 Request processed in 49us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839885.184660:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788839885.184718:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060814720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.184763:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060814720:12345-0@lo:400:kworker.0 Request processed in 500us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839885.184785:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788839885.184797:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788839885.184803:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060814976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.184888:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060814976:12345-0@lo:400:kworker.0 Request processed in 23us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839885.184895:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1788839885.184921:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839885.184924:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839885.184927:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839885.184929:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839885.184941:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839885.184962:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060814080:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.184985:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839885.185000:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060814592:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.185019:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839885.185045:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060814208:0@lo:400:kworker.0 00010000:00080000:1.0:1788839885.185058:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aeed80 x1875734060814720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839885.185067:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060814720:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.185077:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060813696:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.185174:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060814592 00000100:00100000:1.0:1788839885.185178:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060814592 00000100:00100000:1.0:1788839885.185202:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788839885.185213:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060814592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.185243:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060814592:12345-0@lo:400:kworker.0 Request processed in 31us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839885.185249:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1788839885.185261:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839885.185267:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060813568 00000100:00100000:1.0:1788839885.185269:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060813568 00000100:00100000:1.0:1788839885.185281:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788839885.185286:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060813568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839885.185294:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788839885.185315:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060813568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839885.185320:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788839885.185347:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060813568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839885.185355:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060814592:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.185371:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060814080 00000100:00100000:1.0:1788839885.185374:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060814080 00000100:00100000:1.0:1788839885.185392:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788839885.185397:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060814080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.185425:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060814080:12345-0@lo:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839885.185439:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788839885.185463:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060814080:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.185638:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060813440:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.185648:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060813952:0@lo:400:kworker.0 00000100:00100000:3.0:1788839885.186192:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060813184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839885.186474:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060814464:0@lo:400:kworker.0 00010000:00080000:1.0:1788839885.186490:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab744357100 x1875734060814976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839885.186500:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060814976:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.186509:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060813312:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.186519:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060813824:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.186527:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060814336:0@lo:400:kworker.0 00000100:00100000:1.0:1788839885.186535:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060814848:0@lo:400:kworker.0 00000100:00100000:3.0:1788839885.187816:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060815104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839885.187938:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788839885.188192:0:17093:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1788839885.188249:0:17153:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1788839885.188259:0:17153:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:0.0:1788839885.190376:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060815104 00000100:00100000:0.0:1788839885.190389:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060815104 00000100:00100000:0.0:1788839885.190465:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788839885.190475:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060815104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839885.190510:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788839885.190590:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060815104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (2652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839885.190598:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788839885.190677:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060815104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788839885.247117:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788839885.951076:0:17150:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788839885.951085:0:17150:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839885.951129:0:17150:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788839885.951140:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788839886.176235:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839886.176511:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050259200 00000100:00100000:1.0:1788839886.176521:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050259200 00000100:00100000:1.0:1788839886.176590:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788839886.176600:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccda0330-6550-4161-8186-8c642452683e+13:2392:x1875734050259200:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839886.176616:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839886.176636:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782078000/0xad5b343a2657413a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c29 expref: 13 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839886.176654:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839886.177119:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccda0330-6550-4161-8186-8c642452683e+12:2392:x1875734050259200:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 519us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839886.177128:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1788839886.178655:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839886.178697:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839886.178887:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050258944 00000100:00100000:0.0:1788839886.178896:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050258944 00000100:00100000:0.0:1788839886.178957:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050259072 00000100:00100000:0.0:1788839886.178960:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050259072 00000100:00100000:0.0:1788839886.178977:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788839886.178986:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccda0330-6550-4161-8186-8c642452683e+13:2389:x1875734050258944:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839886.178999:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839886.179018:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782078200/0xad5b343a26574133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bf8 expref: 13 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839886.179034:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839886.179079:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccda0330-6550-4161-8186-8c642452683e+12:2389:x1875734050258944:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 94us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839886.179086:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788839886.179108:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788839886.179128:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccda0330-6550-4161-8186-8c642452683e+11:2389:x1875734050259072:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839886.179138:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839886.179148:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de6000/0xad5b343a265741bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cdf expref: 11 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839886.179158:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839886.179179:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccda0330-6550-4161-8186-8c642452683e+10:2389:x1875734050259072:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 51us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839886.179186:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788839886.182423:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839886.182812:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050259456 00000100:00100000:2.0:1788839886.182822:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050259456 00000100:00080000:1.0:1788839886.183148:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839886.183187:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:2.0:1788839886.183198:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+6:2388:x1875734050259456:12345-192.168.203.52@tcp:9:umount.0 00000020:00000080:2.0:1788839886.183236:0:18622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26574156 00000020:00010000:2.0:1788839886.183244:0:18622:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab6479d7800: total 0 00000100:00080000:2.0:1788839886.183249:0:18622:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788839886.183308:0:18622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788839886.183470:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+4:2388:x1875734050259456:12345-192.168.203.52@tcp:9:umount.0 Request processed in 273us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839886.183477:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000020:00010000:0.0:1788839886.183528:0:17102:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab6479d7800: total 0 00010000:00010000:0.0:1788839886.183567:0:17102:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab6479d7800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1788839886.183598:0:17102:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788839886.183602:0:17102:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788839886.183627:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014aaf2ab/0xad5b343a265744cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74dbf expref: 3 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839886.183651:0:17102:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab6479d7800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788839886.183662:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839886.183675:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839886.183677:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788839886.191719:0:18617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb9a0095-2d97-404b-912c-8b552d60d900 00000020:00000080:0.0:1788839886.191728:0:18617:0:(genops.c:885:class_export_put()) final put ffff8ab6479d7800/fb9a0095-2d97-404b-912c-8b552d60d900 00000001:00100000:0.0:1788839886.191758:0:18617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5247e572-2edf-4a2d-83f4-3e72ae063b75 00000020:00000080:0.0:1788839886.191760:0:18617:0:(genops.c:885:class_export_put()) final put ffff8ab6479d1000/5247e572-2edf-4a2d-83f4-3e72ae063b75 00000020:00000080:3.0:1788839886.191897:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6479d7800/fb9a0095-2d97-404b-912c-8b552d60d900 for lustre-OST0000 00000020:00000080:3.0:1788839886.196460:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6479d1000/5247e572-2edf-4a2d-83f4-3e72ae063b75 for lustre-OST0000 00000020:00000080:3.0:1788839886.196536:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6479d4000 for lustre-OST0000 00000020:00000080:3.0:1788839886.196541:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6479d1800 for lustre-OST0000 00000100:00100000:2.0:1788839886.198545:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839886.198685:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050260352 00000100:00100000:1.0:1788839886.198706:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050260352 00000100:00100000:1.0:1788839886.198810:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:1.0:1788839886.198820:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+12:2388:x1875734050260352:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:1.0:1788839886.198850:0:17115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26574148 00000020:00010000:1.0:1788839886.198863:0:17115:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab746a18000: total 0 00000100:00080000:1.0:1788839886.198867:0:17115:0:(import.c:65:import_set_state_nolock()) ffff8ab746a1a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788839886.198896:0:17115:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000100:00100000:1.0:1788839886.199044:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+11:2388:x1875734050260352:12345-192.168.203.52@tcp:39:umount.0 Request processed in 224us (507us total) trans 8589934636 rc 0/0 00000100:00100000:1.0:1788839886.199052:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000020:00010000:3.0:1788839886.199409:0:17101:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab746a18000: total 0 00010000:00010000:3.0:1788839886.199413:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839886.199562:0:17101:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab746a18000, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788839886.199602:0:17101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:3.0:1788839886.199606:0:17101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839886.199615:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a26574419 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d87 expref: 10 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839886.199634:0:17101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:3.0:1788839886.199636:0:17101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788839886.199640:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744dd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74dc6 expref: 9 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839886.199660:0:17101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab647853000) 00010000:00010000:3.0:1788839886.199662:0:17101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839886.199667:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68000/0xad5b343a26574213 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ce6 expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839886.199681:0:17101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:3.0:1788839886.199684:0:17101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788839886.199688:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552000/0xad5b343a265742f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d25 expref: 7 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839886.199706:0:17101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:3.0:1788839886.199708:0:17101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788839886.199712:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574474 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d9c expref: 6 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839886.199726:0:17101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab647853d00) 00010000:00010000:3.0:1788839886.199736:0:17101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839886.199741:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69400/0xad5b343a2657422f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ced expref: 5 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839886.199757:0:17101:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:3.0:1788839886.199759:0:17101:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839886.199763:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a2657426e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cfb expref: 4 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839886.199822:0:17101:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab746a18000, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788839886.199836:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839886.199838:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839886.199840:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839886.200626:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839886.206693:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839886.206797:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050260480 00000100:00100000:3.0:1788839886.206812:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050260480 00000100:00100000:3.0:1788839886.206869:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1788839886.206880:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+5:2388:x1875734050260480:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:3.0:1788839886.206920:0:17114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657414f 00000100:00080000:3.0:1788839886.206938:0:17114:0:(import.c:65:import_set_state_nolock()) ffff8ab64751e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839886.206975:0:17114:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788839886.207217:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+3:2388:x1875734050260480:12345-192.168.203.52@tcp:39:umount.0 Request processed in 339us (534us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788839886.207226:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00010000:00010000:1.0:1788839886.207843:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839886.208164:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:1.0:1788839886.215146:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5247e572-2edf-4a2d-83f4-3e72ae063b75 00000020:00000080:1.0:1788839886.215156:0:19436:0:(genops.c:885:class_export_put()) final put ffff8ab647a06000/5247e572-2edf-4a2d-83f4-3e72ae063b75 00000001:00100000:1.0:1788839886.215186:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fb9a0095-2d97-404b-912c-8b552d60d900 00000020:00000080:1.0:1788839886.215189:0:19436:0:(genops.c:885:class_export_put()) final put ffff8ab6479d0000/fb9a0095-2d97-404b-912c-8b552d60d900 00000020:00000080:2.0:1788839886.215254:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a06000/5247e572-2edf-4a2d-83f4-3e72ae063b75 for lustre-OST0001 00000020:00000080:2.0:1788839886.215302:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6479d0000/fb9a0095-2d97-404b-912c-8b552d60d900 for lustre-OST0001 00000020:00000080:2.0:1788839886.215317:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647a00000 for lustre-OST0001 00000020:00000080:2.0:1788839886.215322:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6479d6800 for lustre-OST0001 00010000:00010000:0.0:1788839886.271432:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839887.295019:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839888.255149:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839888.255174:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060815232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839888.255241:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839888.255805:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060815232 00000100:00100000:0.0:1788839888.255814:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060815232 00000100:00100000:0.0:1788839888.255890:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839888.255901:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060815232:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788839888.256180:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788839888.256270:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788839888.256342:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060815232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 443us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839888.256430:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788839888.256523:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060815232:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788839888.319085:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839888.396691:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839888.396736:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839888.396804:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839888.396878:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050260608 00000100:00100000:0.0:1788839888.396887:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050260608 00000100:00100000:0.0:1788839888.396933:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050260864 00000100:00100000:0.0:1788839888.396936:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050260864 00000100:00100000:0.0:1788839888.396946:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050260736 00000100:00100000:0.0:1788839888.396948:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050260736 00000100:00100000:0.0:1788839888.396962:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788839888.396971:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccda0330-6550-4161-8186-8c642452683e+12:2389:x1875734050260608:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839888.396987:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839888.397006:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782079200/0xad5b343a26574172 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c68 expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839888.397023:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839888.397080:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccda0330-6550-4161-8186-8c642452683e+11:2389:x1875734050260608:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 109us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839888.397088:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788839888.397105:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788839888.397111:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccda0330-6550-4161-8186-8c642452683e+10:2389:x1875734050260864:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839888.397119:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839888.397128:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de7c00/0xad5b343a265741b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd8 expref: 10 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839888.397152:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839888.397170:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccda0330-6550-4161-8186-8c642452683e+9:2389:x1875734050260864:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 59us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839888.397177:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788839888.397190:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788839888.397196:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccda0330-6550-4161-8186-8c642452683e+8:2389:x1875734050260736:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839888.397204:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839888.397212:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab781e69000/0xad5b343a26574179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c99 expref: 8 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839888.397220:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839888.397237:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccda0330-6550-4161-8186-8c642452683e+7:2389:x1875734050260736:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 42us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839888.397242:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1788839888.401477:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839888.401552:0:20599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050261120 00000100:00100000:0.0:1788839888.401563:0:20599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050261120 00000100:00100000:0.0:1788839888.401638:0:20599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:0.0:1788839888.401649:0:20599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2388:x1875734050261120:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:0.0:1788839888.401694:0:20599:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26574187 00000020:00010000:0.0:1788839888.401703:0:20599:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab647a01800: total 0 00000100:00080000:0.0:1788839888.401708:0:20599:0:(import.c:65:import_set_state_nolock()) ffff8ab647a01000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788839888.401799:0:20599:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:0.0:1788839888.401955:0:20599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2388:x1875734050261120:12345-192.168.203.52@tcp:39:umount.0 Request processed in 308us (488us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1788839888.401964:0:20599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000020:00010000:3.0:1788839888.402188:0:17102:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab647a01800: total 0 00010000:00010000:3.0:1788839888.402238:0:17102:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab647a01800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788839888.402269:0:17102:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:3.0:1788839888.402273:0:17102:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839888.402282:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078e00/0xad5b343a2657427c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d02 expref: 4 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839888.402305:0:17102:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab647a01800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788839888.402317:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839888.402318:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839888.402320:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839888.402420:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839888.409679:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839888.414966:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050261248 00000100:00100000:0.0:1788839888.415159:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050261248 00000100:00100000:1.0:1788839888.415314:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:1.0:1788839888.415325:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2388:x1875734050261248:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:1.0:1788839888.415365:0:17113:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657418e 00000100:00080000:1.0:1788839888.415375:0:17113:0:(import.c:65:import_set_state_nolock()) ffff8ab647a05800 : changing import state from FULL to CLOSED 00000100:00080000:2.0:1788839888.415636:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:1.0:1788839888.415681:0:17113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788839888.415879:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+3:2388:x1875734050261248:12345-192.168.203.52@tcp:39:umount.0 Request processed in 554us (6206us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788839888.415887:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00010000:00010000:0.0:1788839888.416384:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839888.481042:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839888.481229:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050261504 00000100:00100000:0.0:1788839888.481240:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050261504 00000100:00100000:0.0:1788839888.481308:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:0.0:1788839888.481318:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+7:2388:x1875734050261504:12345-192.168.203.52@tcp:251:umount.0 00000020:00000080:0.0:1788839888.481365:0:17107:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26574125 00000020:00010000:0.0:1788839888.481372:0:17107:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab647a02000: total 0 00000100:00080000:0.0:1788839888.481377:0:17107:0:(import.c:65:import_set_state_nolock()) ffff8ab647a03000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788839888.481474:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+3:2388:x1875734050261504:12345-192.168.203.52@tcp:251:umount.0 Request processed in 158us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839888.481482:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 171 00000020:00010000:1.0:1788839888.481531:0:18648:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab647a02000: total 0 00010000:00010000:1.0:1788839888.481585:0:18648:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab647a02000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788839888.481619:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782078a00/0xad5b343a2657412c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bf1 expref: 2 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839888.481647:0:18648:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab647a02000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788839888.481658:0:18648:0:(genops.c:885:class_export_put()) final put ffff8ab647a02000/ccda0330-6550-4161-8186-8c642452683e 00010000:00010000:1.0:1788839888.481675:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839888.481678:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839888.481680:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788839888.482231:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a02000/ccda0330-6550-4161-8186-8c642452683e for MGS 00000020:00000080:0.0:1788839888.483229:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647a03000 for MGS 00000100:00100000:1.0:1788839889.279982:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060815360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839889.280050:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839889.280135:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060815360 00000100:00100000:1.0:1788839889.280143:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060815360 00000100:00100000:2.0:1788839889.280160:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060815488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839889.280190:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788839889.280198:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839889.280203:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060815360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839889.280236:0:17119:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788839889.280250:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060815488 00000100:00100000:2.0:1788839889.280256:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060815488 00000100:00100000:1.0:1788839889.280277:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060815360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839889.280284:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788839889.280507:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060815488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788839889.280529:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788839889.280581:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060815488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 288us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839889.280616:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060815488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839889.283354:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788839889.285725:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788839889.295187:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060815360:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788839889.343169:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839889.343386:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788839890.074393:0:20686:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788839890.091927:0:20686:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788839890.091980:0:20686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.091993:0:20686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.092002:0:20686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.092009:0:20686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.092044:0:20686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788839890.092051:0:20686:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788839890.092081:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788839890.092086:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788839890.092091:0:20686:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788839890.092114:0:20686:0:(import.c:65:import_set_state_nolock()) ffff8ab646523000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788839890.092632:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839890.092641:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839890.092650:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552400 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839890.092654:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839890.092665:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839890.092671:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839890.092677:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788839890.092679:0:17101:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788839890.092681:0:17101:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788839890.092710:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839890.092715:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839890.092744:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839890.092751:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839890.092794:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839890.092796:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839890.092798:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839890.092815:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060815616:0@lo:39:umount.0 00000100:00100000:2.0:1788839890.092880:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839890.092951:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060815616 00000100:00100000:2.0:1788839890.092958:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060815616 00000100:00100000:2.0:1788839890.093005:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788839890.093013:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1875734060815616:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788839890.093038:0:17149:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573d19 00000100:00080000:2.0:1788839890.093047:0:17149:0:(import.c:65:import_set_state_nolock()) ffff8ab647a24800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788839890.093103:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3613:x1875734060815616:12345-0@lo:39:umount.0 Request processed in 90us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839890.093110:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:2.0:1788839890.093119:0:17149:0:(genops.c:885:class_export_put()) final put ffff8ab781984800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788839890.093140:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839890.093165:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646523000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788839890.093175:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060815616:0@lo:39:umount.0 00000100:00100000:0.0:1788839890.093238:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839890.093250:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060815744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839890.093297:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788839890.093337:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab781984800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788839890.093375:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647a24800 for lustre-MDT0000 00000100:00100000:2.0:1788839890.093471:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060815744 00000100:00100000:2.0:1788839890.093475:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060815744 00000100:00100000:2.0:1788839890.093516:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788839890.093523:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d08050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3617:x1875734060815744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839890.093536:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839890.093552:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647958800/0xad5b343a26573cef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573ce8 expref: 24 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839890.093580:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839890.093611:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d08050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:3617:x1875734060815744:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839890.093619:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788839890.093670:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060815744:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788839890.095655:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788839890.095663:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788839890.095671:0:20686:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788839890.097391:0:20686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.097418:0:20686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.097425:0:20686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.097432:0:20686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.097501:0:20686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788839890.097509:0:20686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.097515:0:20686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.097538:0:20686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.097543:0:20686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.097598:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839890.097605:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.097612:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553800 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839890.097616:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.097625:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839890.097631:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839890.097637:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788839890.097639:0:17102:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788839890.097670:0:17102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.097685:0:17102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839890.097720:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.097727:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.097741:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839890.097744:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.097750:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839890.097753:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.097760:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839890.097766:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839890.097790:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788839890.097793:0:17102:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788839890.097805:0:17102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.097810:0:17102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839890.097827:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.097844:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839890.097845:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839890.097848:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839890.097867:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060816000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839890.097926:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.097983:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060816000 00000100:00100000:3.0:1788839890.097989:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060816000 00000100:00100000:3.0:1788839890.098027:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839890.098034:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:3614:x1875734060816000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839890.098045:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839890.098058:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553200/0xad5b343a26573f88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573f81 expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.098070:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839890.098095:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:3614:x1875734060816000:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839890.098102:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839890.098133:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060816000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839890.098196:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839890.098207:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060815872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839890.098233:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.098352:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060815872 00000100:00100000:3.0:1788839890.098356:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060815872 00000100:00100000:3.0:1788839890.098385:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839890.098391:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:3616:x1875734060815872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839890.098408:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839890.098417:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647bfc800/0xad5b343a26573c40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573c39 expref: 22 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.098435:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839890.098460:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:3616:x1875734060815872:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839890.098466:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839890.098486:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060815872:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839890.098617:0:20686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788839890.098623:0:20686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839890.098633:0:20686:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788839890.098642:0:20686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.098649:0:20686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.098656:0:20686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.098662:0:20686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839890.098686:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839890.098692:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839890.098699:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839890.098702:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839890.098709:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839890.098716:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839890.098722:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788839890.098724:0:17101:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788839890.098739:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839890.098744:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788839890.098785:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788839890.098815:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839890.098823:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839890.098829:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839890.098831:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839890.098919:0:20686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788839890.098923:0:20686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839890.098931:0:20686:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788839890.098943:0:20686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.098949:0:20686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.098955:0:20686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.098961:0:20686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839890.099005:0:20686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788839890.099009:0:20686:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788839890.099012:0:20686:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788839890.099040:0:20686:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788839890.099043:0:20686:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788839890.099047:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839890.099052:0:20686:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788839890.099057:0:20686:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab647a07000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839890.099062:0:20686:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab646639800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839890.099067:0:20686:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab747eed800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839890.099071:0:20686:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab744349000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839890.099077:0:20686:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8ab647a01800 5247e572-2edf-4a2d-83f4-3e72ae063b75 192.168.203.52@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1788839890.099082:0:20686:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8ab746a18000 fb9a0095-2d97-404b-912c-8b552d60d900 192.168.203.52@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934635 stale:0 00000020:00080000:1.0:1788839890.099086:0:20686:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8ab77e7919b8) has exports, disconnecting them 00000020:00080000:1.0:1788839890.099090:0:20686:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab647a07000), last request at 1788839885 00000020:00000080:1.0:1788839890.099095:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573f50 00000100:00080000:1.0:1788839890.099113:0:20686:0:(import.c:65:import_set_state_nolock()) ffff8ab647a03800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788839890.099138:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060816128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839890.099176:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839890.099249:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839890.099254:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.099270:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839890.099273:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.099279:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839890.099286:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839890.099290:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788839890.099293:0:17102:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788839890.099305:0:17102:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788839890.099321:0:17102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.099326:0:17102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839890.099349:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.099363:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.099373:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839890.099374:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839890.099376:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839890.099381:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839890.099389:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060816256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839890.099424:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.099448:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060816128 00000100:00100000:3.0:1788839890.099452:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060816128 00000100:00100000:3.0:1788839890.099477:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060816256 00000100:00100000:3.0:1788839890.099479:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060816256 00000100:00100000:3.0:1788839890.099490:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839890.099495:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:3614:x1875734060816128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839890.099504:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839890.099513:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647959000/0xad5b343a265741f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a265741f0 expref: 22 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.099522:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839890.099546:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:3614:x1875734060816128:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839890.099552:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839890.099563:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839890.099568:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:3617:x1875734060816256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839890.099574:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839890.099581:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647843000/0xad5b343a26573c32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573c2b expref: 20 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839890.099594:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839890.099614:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:3617:x1875734060816256:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839890.099619:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839890.099640:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060816256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839890.099661:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060816128:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788839890.100236:0:20686:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab647a07000): rc 0 00000020:00000080:1.0:1788839890.100240:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab647a07000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788839890.100265:0:20686:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab646639800), last request at 1788839885 00000020:00000080:1.0:1788839890.100270:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573eb6 00000100:00080000:1.0:1788839890.100277:0:20686:0:(import.c:65:import_set_state_nolock()) ffff8ab64663b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788839890.100287:0:20686:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab646639800): rc 0 00000020:00000080:1.0:1788839890.100289:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab646639800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788839890.100294:0:20686:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab747eed800), last request at 1788839817 00000020:00000080:1.0:1788839890.100297:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573e07 00000100:00080000:1.0:1788839890.100300:0:20686:0:(import.c:65:import_set_state_nolock()) ffff8ab75e470800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788839890.100305:0:20686:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab747eed800): rc 0 00000020:00000080:1.0:1788839890.100307:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab747eed800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788839890.100310:0:20686:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab744349000), last request at 1788839817 00000020:00000080:1.0:1788839890.100313:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573dac 00000100:00080000:1.0:1788839890.100316:0:20686:0:(import.c:65:import_set_state_nolock()) ffff8ab753b7d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788839890.100322:0:20686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00080000:1.0:1788839890.100385:0:20686:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab744349000): rc 0 00000004:00000080:1.0:1788839890.100391:0:20686:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb69881be3ae0 00000100:00080000:1.0:1788839890.100415:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788839890.100418:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788839890.101224:0:20686:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788839890.101248:0:20686:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000020:00000080:3.0:1788839890.101389:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a07000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788839890.101451:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646639800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788839890.101471:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab747eed800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788839890.101496:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647a03800 for lustre-MDT0000 00000020:00000080:3.0:1788839890.101499:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab64663b000 for lustre-MDT0000 00000020:00000080:3.0:1788839890.101502:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab75e470800 for lustre-MDT0000 00010000:00010000:3.0:1788839890.101512:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839890.101584:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839890.103937:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060816384:0@lo:39:umount.0 00000100:00100000:1.0:1788839890.104016:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.104110:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060816384 00000100:00100000:3.0:1788839890.104118:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060816384 00000100:00100000:3.0:1788839890.104171:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788839890.104181:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1875734060816384:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788839890.104212:0:17119:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573e31 00000100:00080000:3.0:1788839890.104220:0:17119:0:(import.c:65:import_set_state_nolock()) ffff8ab7487dc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839890.104243:0:17119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788839890.104372:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3613:x1875734060816384:12345-0@lo:39:umount.0 Request processed in 192us (355us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788839890.104379:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1788839890.104427:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788839890.104434:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060816384:0@lo:39:umount.0 00010000:00010000:3.0:1788839890.104459:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788839890.104975:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788839890.104979:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1788839890.104994:0:20686:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788839890.105059:0:20686:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788839890.105074:0:20686:0:(import.c:65:import_set_state_nolock()) ffff8ab646534800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788839890.105086:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788839890.105088:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:1.0:1788839890.105096:0:20686:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788839890.105159:0:20686:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788839890.105168:0:20686:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788839890.105205:0:20686:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ab77e7919b8) has no exports 00000100:00100000:3.0:1788839890.105352:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060816512:0@lo:9:umount.0 00000100:00100000:3.0:1788839890.105389:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.105421:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060816640:0@lo:9:umount.0 00000100:00100000:3.0:1788839890.105441:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.105469:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060816512 00000100:00100000:3.0:1788839890.105474:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060816512 00000100:00100000:3.0:1788839890.105511:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060816640 00000100:00100000:3.0:1788839890.105514:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060816640 00000100:00100000:3.0:1788839890.105532:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839890.105539:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3613:x1875734060816512:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788839890.105557:0:19600:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573f8f 00000100:00080000:3.0:1788839890.105562:0:19600:0:(import.c:65:import_set_state_nolock()) ffff8ab64751b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839890.105596:0:19600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788839890.105690:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3613:x1875734060816512:12345-0@lo:9:umount.0 Request processed in 152us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839890.105696:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839890.105706:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788839890.105711:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3613:x1875734060816640:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788839890.105720:0:19600:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573f96 00000100:00080000:3.0:1788839890.105725:0:19600:0:(import.c:65:import_set_state_nolock()) ffff8ab64751a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839890.105741:0:19600:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788839890.105833:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3613:x1875734060816640:12345-0@lo:9:umount.0 Request processed in 121us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839890.105839:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788839890.105858:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839890.105861:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788839890.105883:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788839890.105905:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646534800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788839890.105913:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788839890.105915:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788839890.105918:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060816512:0@lo:9:umount.0 00000100:00080000:3.0:1788839890.105928:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788839890.105935:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788839890.105936:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788839890.105939:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060816640:0@lo:9:umount.0 00010000:00010000:2.0:1788839890.106504:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839890.106509:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788839890.114246:0:20686:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ab77e7919b8) has no exports 00000020:00000080:2.0:1788839890.149064:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573c86 00000020:00000080:2.0:1788839890.149080:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab77e7a2000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788839890.149146:0:20686:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788839890.149218:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839890.149228:0:20686:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788839890.149233:0:20686:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8ab6479a19b8) has no exports 00000020:00000080:0.0:1788839890.149675:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573c7f 00000020:00000080:0.0:1788839890.149681:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab777b43000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788839890.149708:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e7a2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788839890.150562:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab777b43000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788839890.150631:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839890.150639:0:20686:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788839890.150643:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab646b67800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788839890.150645:0:20686:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b67800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788839890.150651:0:20686:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:0.0:1788839890.303253:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060816768:0@lo:400:kworker.0 00000100:00100000:0.0:1788839890.303321:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839890.303364:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060817280:0@lo:400:kworker.0 00000100:00100000:0.0:1788839890.303387:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839890.303421:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788839890.303428:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060817152:0@lo:400:kworker.0 00000100:00100000:0.0:1788839890.303447:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839890.303461:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060817664:0@lo:400:kworker.0 00000100:00100000:0.0:1788839890.303478:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839890.303600:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060816768 00000100:00100000:1.0:1788839890.303618:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060816768 00000100:00100000:1.0:1788839890.303680:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788839890.303687:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875734060816768:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788839890.303695:0:17118:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788839890.303737:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3617:x1875734060816768:12345-0@lo:400:kworker.0 Request processed in 49us (416us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788839890.303743:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788839890.303766:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060817280 00000100:00100000:1.0:1788839890.303789:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060817280 00000100:00100000:1.0:1788839890.303808:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060817152 00000100:00100000:1.0:1788839890.303811:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060817152 00000100:00100000:1.0:1788839890.303822:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060817664 00000100:00100000:1.0:1788839890.303824:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060817664 00000100:00100000:1.0:1788839890.303862:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788839890.303869:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060817664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839890.303908:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060817664:12345-0@lo:400:kworker.0 Request processed in 39us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839890.303913:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788839890.303941:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788839890.303945:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875734060817280:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788839890.303949:0:17115:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788839890.303971:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875734060817280:12345-0@lo:400:kworker.0 Request processed in 25us (583us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788839890.303976:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788839890.303986:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788839890.303990:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875734060817152:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788839890.303995:0:17115:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788839890.304015:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875734060817152:12345-0@lo:400:kworker.0 Request processed in 24us (567us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788839890.304020:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788839890.304055:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788839890.304060:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8ab745344000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788839890.304063:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788839890.307504:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060817024:0@lo:400:kworker.0 00000100:00100000:3.0:1788839890.307573:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.307603:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060817536:0@lo:400:kworker.0 00000100:00100000:3.0:1788839890.307625:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.307649:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788839890.307656:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060816896:0@lo:400:kworker.0 00000100:00100000:3.0:1788839890.307673:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.307687:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060817408:0@lo:400:kworker.0 00000100:00100000:3.0:1788839890.307702:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.307728:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060817536 00000100:00100000:3.0:1788839890.307734:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060817536 00000100:00100000:3.0:1788839890.307763:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060817408 00000100:00100000:3.0:1788839890.307764:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060817408 00000100:00100000:3.0:1788839890.307804:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788839890.307812:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060817408:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788839890.307968:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788839890.307983:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788839890.307988:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875734060817536:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788839890.307994:0:17115:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788839890.308027:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875734060817536:12345-0@lo:400:kworker.0 Request processed in 38us (401us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788839890.308033:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788839890.308076:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060817024 00000100:00100000:0.0:1788839890.308080:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060817024 00000100:00100000:0.0:1788839890.308103:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060816896 00000100:00100000:0.0:1788839890.308106:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060816896 00000100:00100000:0.0:1788839890.308133:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839890.308139:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060817024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839890.308171:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060817024:12345-0@lo:400:kworker.0 Request processed in 32us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839890.308179:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839890.308191:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788839890.308196:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060816896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839890.308220:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060816896:12345-0@lo:400:kworker.0 Request processed in 25us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839890.308225:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788839890.308236:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839890.308239:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839890.308281:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060816896:0@lo:400:kworker.0 00000100:00100000:0.0:1788839890.308290:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060817024:0@lo:400:kworker.0 00000100:00080000:0.0:1788839890.308907:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788839890.308912:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ac000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788839890.308916:0:3615:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788839890.308920:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ac000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839890.308924:0:3615:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 501 00000100:00080000:0.0:1788839890.308931:0:3615:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab6475ac000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839890.308955:0:3615:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab744354e00 x1875734060817920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839890.308985:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060817536:0@lo:400:kworker.0 00000100:00100000:2.0:1788839890.309290:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839890.309315:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060817792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839890.309350:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839890.309382:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060817792 00000100:00100000:2.0:1788839890.309387:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060817792 00000100:00100000:2.0:1788839890.309431:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839890.309440:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060817792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839890.309464:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788839890.309499:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060817792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839890.309505:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839890.309540:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060817792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839890.309640:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060817920:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788839890.309666:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839890.309693:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060817920 00000100:00100000:2.0:1788839890.309697:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060817920 00000100:00100000:2.0:1788839890.309716:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788839890.309721:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875734060817920:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788839890.309733:0:17115:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788839890.309953:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060817408:12345-0@lo:400:kworker.0 Request processed in 2140us (2248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839890.309961:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:0.0:1788839890.310231:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aeed80 x1875734060817408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839890.310242:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060817408:0@lo:400:kworker.0 00000100:00080000:1.0:1788839890.325623:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8ab745344000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788839890.325633:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:1.0:1788839890.325643:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ab745344000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839890.325683:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4ed80 x1875734060818048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839890.325721:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060817152:0@lo:400:kworker.0 00010000:00080000:1.0:1788839890.325756:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b4ce00 x1875734060817664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839890.325766:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060817664:0@lo:400:kworker.0 00000100:00080000:1.0:1788839890.325812:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788839890.325828:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788839890.325831:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788839890.325836:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788839890.325839:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:1.0:1788839890.325843:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ab77e444800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839890.325855:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4ea00 x1875734060818176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839890.325866:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060816768:0@lo:400:kworker.0 00000100:00080000:1.0:1788839890.325879:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788839890.325882:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8ab75867c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788839890.325885:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788839890.325887:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8ab75867c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788839890.325891:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 486 00000100:00080000:1.0:1788839890.325894:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab75867c000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839890.325906:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4c700 x1875734060818304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839890.325914:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060817280:0@lo:400:kworker.0 00000100:00100000:3.0:1788839890.327298:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060818048:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788839890.327372:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.327425:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060818176:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788839890.327452:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.327474:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060818304:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788839890.327495:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839890.327537:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060818176 00000100:00100000:3.0:1788839890.327543:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060818176 00000100:00100000:3.0:1788839890.327578:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788839890.327589:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3613:x1875734060818176:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788839890.327617:0:18138:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788839890.327665:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3613:x1875734060818176:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 75us (212us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788839890.327672:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788839890.327696:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060818048 00000100:00100000:3.0:1788839890.327700:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060818048 00000100:00100000:3.0:1788839890.327716:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060818304 00000100:00100000:3.0:1788839890.327718:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060818304 00000100:00100000:3.0:1788839890.327731:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788839890.327736:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060818048:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788839890.327743:0:17149:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788839890.327767:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060818048:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 30us (395us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788839890.327796:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788839890.327806:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788839890.327810:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060818304:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788839890.327817:0:17149:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788839890.327853:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060818304:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 41us (357us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788839890.327859:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788839890.327894:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab745344000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839890.327898:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788839890.327901:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060818048:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788839890.327910:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839890.327913:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788839890.327916:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060818176:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788839890.327923:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab75867c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839890.327926:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788839890.327928:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060818304:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788839890.351608:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875734060817920:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 41876us (41931us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788839890.351636:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788839890.351933:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ac000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839890.351940:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788839890.351944:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060817920:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:3.0:1788839890.366912:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839891.390887:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788839891.841528:0:17847:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788839891.841546:0:17847:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1788839891.841552:0:17847:0:(genops.c:885:class_export_put()) final put ffff8ab74434e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788839891.841617:0:17847:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5247e572-2edf-4a2d-83f4-3e72ae063b75 00000001:00080000:2.0:1788839891.841623:0:17847:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1788839891.841626:0:17847:0:(genops.c:885:class_export_put()) final put ffff8ab647a02800/5247e572-2edf-4a2d-83f4-3e72ae063b75 00000020:00000080:3.0:1788839891.845695:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab74434e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788839891.845801:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab7487dc800 for lustre-MDT0001 00000001:00100000:2.0:1788839891.847533:0:17847:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fb9a0095-2d97-404b-912c-8b552d60d900 00000001:00080000:2.0:1788839891.847546:0:17847:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1788839891.847552:0:17847:0:(genops.c:885:class_export_put()) final put ffff8ab64751d800/fb9a0095-2d97-404b-912c-8b552d60d900 00000020:00000080:1.0:1788839891.847847:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a02800/5247e572-2edf-4a2d-83f4-3e72ae063b75 for lustre-MDT0001 00000020:00000080:1.0:1788839891.847903:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64751d800/fb9a0095-2d97-404b-912c-8b552d60d900 for lustre-MDT0001 00000020:00000080:1.0:1788839891.847925:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647a05800 for lustre-MDT0001 00000020:00000080:1.0:1788839891.847929:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab64751e800 for lustre-MDT0001 00000001:00100000:1.0:1788839891.848525:0:17093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788839891.848530:0:17093:0:(genops.c:885:class_export_put()) final put ffff8ab744349000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788839891.848562:0:17093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5247e572-2edf-4a2d-83f4-3e72ae063b75 00000001:00080000:1.0:1788839891.848571:0:17093:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:1.0:1788839891.848574:0:17093:0:(genops.c:885:class_export_put()) final put ffff8ab647a01800/5247e572-2edf-4a2d-83f4-3e72ae063b75 00000001:00100000:1.0:1788839891.848579:0:17093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fb9a0095-2d97-404b-912c-8b552d60d900 00000001:00080000:1.0:1788839891.848583:0:17093:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:1.0:1788839891.848585:0:17093:0:(genops.c:885:class_export_put()) final put ffff8ab746a18000/fb9a0095-2d97-404b-912c-8b552d60d900 00000020:00000080:3.0:1788839891.848639:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab744349000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788839891.848668:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a01800/5247e572-2edf-4a2d-83f4-3e72ae063b75 for lustre-MDT0000 00000020:00000080:3.0:1788839891.848700:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab746a18000/fb9a0095-2d97-404b-912c-8b552d60d900 for lustre-MDT0000 00000020:00000080:3.0:1788839891.848724:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab753b7d800 for lustre-MDT0000 00000020:00000080:3.0:1788839891.848728:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647a01000 for lustre-MDT0000 00000020:00000080:3.0:1788839891.848731:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab746a1a800 for lustre-MDT0000 00000020:01000000:0.0:1788839892.159126:0:20686:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab7750dcc00 - data ffff8ab641c805e8/ffff8ab781ec6c00 00000020:01000000:0.0:1788839892.159317:0:20686:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab75e7652a0 - data ffff8ab641c131b0/ffff8ab74fe09400 00000001:00000004:0.0:1788839892.170104:0:20686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:2.0:1788839892.252525:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788839892.252535:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788839892.252549:0:20686:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ab777c76300 x1875734060816384/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788839900 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839892.252579:0:20686:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788839892.257253:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788839892.257261:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1788839892.257284:0:20686:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839892.257287:0:20686:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788839892.258242:0:17137:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788839892.258247:0:17137:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:1.0:1788839892.258257:0:17137:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1788839892.258929:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788839892.258934:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1788839892.258948:0:20686:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839892.258950:0:20686:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788839892.259508:0:17139:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788839892.259513:0:17139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1788839892.259520:0:17139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:0.0:1788839892.266137:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573c4e 00000020:00000080:0.0:1788839892.266224:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab74434f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788839892.266402:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab74434f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788839892.273367:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573c63 00000020:00000080:0.0:1788839892.273993:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab647a22000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788839892.274315:0:20686:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788839892.274452:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839892.274461:0:20686:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788839892.274466:0:20686:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8ab77e794d28) has no exports 00000004:01000000:0.0:1788839892.274637:0:20686:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788839892.274645:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573cc5 00000020:00000080:0.0:1788839892.274649:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab646530000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839892.281907:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a22000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788839892.286340:0:20686:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788839892.286379:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839892.286407:0:20686:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788839892.286412:0:20686:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8ab7486eb370) has no exports 00000020:00000080:0.0:1788839892.286421:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573cbe 00000020:00000080:0.0:1788839892.286429:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab647a20000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788839892.286618:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646530000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788839892.287662:0:20686:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788839892.287667:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788839892.287671:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:0.0:1788839892.287679:0:20686:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839892.287681:0:20686:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839892.287713:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a20000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788839892.287946:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839892.287955:0:20686:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788839892.287964:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573cb0 00000020:00000080:0.0:1788839892.287972:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab646537800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839892.287995:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647a27000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788839892.288005:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab646531000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839892.288007:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646531000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788839892.288011:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788839892.288281:0:20686:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788839892.288286:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839892.288291:0:20686:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788839892.288295:0:20686:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8ab7486e8000) has no exports 00000020:00000080:0.0:1788839892.288300:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573ca9 00000020:00000080:0.0:1788839892.288304:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab646536800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788839892.288324:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646537800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1788839892.288704:0:20686:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788839892.288707:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788839892.288709:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:0.0:1788839892.288713:0:20686:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839892.288715:0:20686:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839892.288898:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646536800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788839892.288977:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839892.288983:0:20686:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788839892.288997:0:20686:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788839892.289003:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573c9b 00000020:00000080:0.0:1788839892.289008:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab646535000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839892.289027:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646534800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788839892.289110:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab646533800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839892.289115:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646533800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788839892.289119:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788839892.289264:0:20686:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788839892.289269:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839892.289272:0:20686:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788839892.289280:0:20686:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8ab77e793370) has no exports 00000020:00000080:0.0:1788839892.289285:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573c94 00000020:00000080:0.0:1788839892.289289:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab647a26000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788839892.289310:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646535000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788839892.290513:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a26000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788839892.291864:0:20686:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788839892.291870:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788839892.291875:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788839892.291882:0:20686:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788839892.291929:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839892.291979:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647a27800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788839892.291996:0:20686:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839892.292001:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab647a26800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788839892.292004:0:20686:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a26800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788839892.292015:0:20686:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839892.292174:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839892.292178:0:20686:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839892.292181:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab74434b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788839892.292183:0:20686:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab74434b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788839892.292187:0:20686:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839892.292232:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573c6a 00000020:00000080:1.0:1788839892.292238:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab647a21000/lustre-MDD0000_UUID 00000020:01000000:1.0:1788839892.292249:0:20686:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788839892.292253:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839892.292267:0:20686:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788839892.292271:0:20686:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8ab77e790000) has no exports 00000020:00000080:1.0:1788839892.292291:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839892.292294:0:20686:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788839892.292298:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573c71 00000020:00000080:1.0:1788839892.292306:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab647a25000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788839892.292316:0:20686:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab64817e800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788839892.292319:0:20686:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab64817e800 3 00000020:01000004:1.0:1788839892.292322:0:20686:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab64817e800 from lustre-MDT0000 00000020:00000080:1.0:1788839892.292340:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839892.292345:0:20686:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788839892.292347:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab74434d000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788839892.292349:0:20686:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab74434d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788839892.292355:0:20686:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788839892.292400:0:20686:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788839892.292403:0:20686:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788839892.292406:0:20686:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788839892.292408:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839892.292410:0:20686:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788839892.292416:0:20686:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ab648899800 d4b73860-6950-4a5d-8d03-52a643e5ff43 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839892.292421:0:20686:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8ab6479a3370) has exports, disconnecting them 00000020:00080000:1.0:1788839892.292425:0:20686:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ab648899800), last request at 1788839803 00000020:00000080:1.0:1788839892.292437:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573c16 00000020:00010000:1.0:1788839892.292441:0:20686:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab648899800: total 2 00000100:00080000:1.0:1788839892.292444:0:20686:0:(import.c:65:import_set_state_nolock()) ffff8ab648899000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788839892.292454:0:20686:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab648899800): rc 0 00000020:00080000:1.0:1788839892.292458:0:20686:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8ab6479a3370) has no exports 00000020:00010000:2.0:1788839892.292566:0:18648:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab648899800: total 2 00010000:00010000:2.0:1788839892.292570:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839892.292602:0:18648:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab648899800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788839892.292628:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647959400/0xad5b343a265741e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a265741e2 expref: 14 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292642:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de6a00/0xad5b343a265741db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a265741d4 expref: 13 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292652:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647958400/0xad5b343a26573d51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573d4a expref: 12 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292661:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647843600/0xad5b343a26573f3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573f34 expref: 11 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292670:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647843800/0xad5b343a26573f7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573f73 expref: 10 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292682:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647bfd800/0xad5b343a26573e77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573e70 expref: 9 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292691:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552600/0xad5b343a26573d35 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573d2e expref: 8 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292711:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ea1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573e9a expref: 7 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292720:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782079000/0xad5b343a265741cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a265741c6 expref: 6 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292730:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553400/0xad5b343a26573df2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573deb expref: 5 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292748:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552a00/0xad5b343a26573d43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573d3c expref: 4 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292758:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647959c00/0xad5b343a26573c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573c1d expref: 3 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292766:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647bfda00/0xad5b343a26573f11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26573f0a expref: 2 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839892.292800:0:18648:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab648899800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788839892.292812:0:18648:0:(genops.c:885:class_export_put()) final put ffff8ab648899800/d4b73860-6950-4a5d-8d03-52a643e5ff43 00010000:00010000:2.0:1788839892.292816:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839892.292818:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839892.292820:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839892.292869:0:17105:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ab777b3f800:17105] 0 exiting: rc = 1 00000100:00100000:1.0:1788839892.293288:0:17108:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ab646869c00:17108] 2 exiting: rc = 0 00000020:00000080:2.0:1788839892.293379:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a21000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788839892.293394:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab74434c800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788839892.293396:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab74434c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788839892.293400:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788839892.293443:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a25000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788839892.293454:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab648899800/d4b73860-6950-4a5d-8d03-52a643e5ff43 for MGS 00000020:00000080:2.0:1788839892.293515:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab648899000 for MGS 00000100:00100000:1.0:1788839892.295882:0:17107:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ab646868200:17107] 1 exiting: rc = 0 00000100:00100000:2.0:1788839892.295940:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.295948:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.295955:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.295959:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.295964:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.295970:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.295977:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.295983:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.295989:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.295994:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.295999:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296006:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296122:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296133:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296139:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296144:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296149:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296154:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296160:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296165:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296170:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296175:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296180:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296185:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296190:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296196:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296202:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296207:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296213:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296218:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296223:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296229:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296244:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296249:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296254:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296259:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296264:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296270:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296276:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296281:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296287:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296292:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296296:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296301:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296306:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296311:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296315:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296320:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296325:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296330:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296335:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296340:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296345:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296349:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296354:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296358:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296363:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296367:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296373:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296379:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296394:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296400:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296405:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839892.296410:0:20686:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788839892.297350:0:20686:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab647a095a0 - data ffff8ab75f0d9a20/ffff8ab646796c00 00000020:01000000:2.0:1788839892.297488:0:20686:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6468704e0 - data ffff8ab75f2a9948/ffff8ab780013400 00000020:00000080:1.0:1788839892.299574:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573bfa 00000020:00000080:1.0:1788839892.299587:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab7467bc800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788839892.300153:0:20686:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab64817e800 from MGS, refs=2 00000020:01000004:1.0:1788839892.300169:0:20686:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab64817e800 2 00000020:01000004:1.0:1788839892.300173:0:20686:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab64817e800 from MGS 00000020:00000080:1.0:1788839892.300196:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839892.300203:0:20686:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788839892.300206:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab7467b9000/MGS 00000020:00000080:1.0:1788839892.300209:0:20686:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7467b9000/MGS for MGS 00000020:01000000:1.0:1788839892.300217:0:20686:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788839892.300282:0:20686:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788839892.300286:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839892.300292:0:20686:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788839892.300299:0:20686:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ab646526800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839892.300304:0:20686:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8ab6479a4d28) has exports, disconnecting them 00000020:00080000:1.0:1788839892.300310:0:20686:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ab646526800), last request at 1788839803 00000020:00000080:1.0:1788839892.300313:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573cfd 00000020:00080000:1.0:1788839892.300325:0:20686:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab646526800): rc 0 00000020:00000080:1.0:1788839892.300329:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab646526800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788839892.302217:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7467bc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788839892.304571:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646526800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788839892.324207:0:20686:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788839892.324217:0:20686:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839892.324221:0:20686:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788839892.324228:0:20686:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839892.324257:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646523000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788839892.324431:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839892.324439:0:20686:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788839892.324444:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab777b47000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788839892.324448:0:20686:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab777b47000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788839892.324455:0:20686:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788839892.324536:0:20686:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab64817e800 1 00000020:00000080:2.0:1788839892.324542:0:20686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573bec 00000020:00000080:2.0:1788839892.324548:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab7467b9800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788839892.324557:0:20686:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788839892.324564:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7467b9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788839892.324573:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839892.324577:0:20686:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788839892.324580:0:20686:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ab6479ecd28) has no exports 00010000:00010000:3.0:1788839892.516627:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788839892.525518:0:20686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839892.525533:0:20686:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788839892.525539:0:20686:0:(genops.c:885:class_export_put()) final put ffff8ab64817d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788839892.525543:0:20686:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64817d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788839892.525554:0:20686:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788839892.525698:0:20686:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab648178800 00000020:02000400:2.0:1788839892.525760:0:20686:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1788839893.386184:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839893.386205:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060818432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839893.386278:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839893.386535:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060818432 00000100:00100000:0.0:1788839893.386542:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060818432 00000100:00100000:0.0:1788839893.386601:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788839893.386610:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060818432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839893.386639:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788839893.386681:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060818432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839893.386688:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788839893.386732:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060818432:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788839893.386833:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788839893.567007:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839894.592925:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788839895.424758:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839895.424764:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788839895.424804:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839895.424812:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 545 00000100:00100000:1.0:1788839895.424815:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060818560:0@lo:400:kworker.0 00000100:00080000:0.0:1788839895.424819:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839895.424828:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ab77e444800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839895.424854:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab744354a80 x1875734060818688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1788839895.424871:0:3615:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875734060818560 offset 0 length 224: 4 00000100:00080000:0.0:1788839895.424907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839895.424911:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788839895.424913:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab745344000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839895.424926:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 545 00000100:00080000:0.0:1788839895.424929:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839895.424935:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ab745344000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839895.424936:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060818944:0@lo:400:kworker.0 00000100:00100000:0.0:1788839895.424953:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777c76680 x1875734060819072/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839895.424964:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839895.424967:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788839895.424969:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab75867c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788839895.424976:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839895.424978:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 545 00000100:00080000:0.0:1788839895.424982:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839895.424986:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab75867c000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839895.425001:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777c77480 x1875734060819200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839895.425003:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839895.425013:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060818816:0@lo:400:kworker.0 00000100:00100000:1.0:1788839895.425036:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839895.425041:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839895.425046:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788839895.425048:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ac000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839895.425053:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 545 00000100:00080000:0.0:1788839895.425056:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839895.425060:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab6475ac000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839895.425069:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060818944 00000100:00100000:0.0:1788839895.425075:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777c77100 x1875734060819456/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839895.425077:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060818944 00000100:00100000:1.0:1788839895.425129:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060818816 00000100:00100000:1.0:1788839895.425132:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060818816 00000100:00100000:0.0:1788839895.425146:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060818688:0@lo:38:kworker.0 00000100:00100000:1.0:1788839895.425158:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788839895.425167:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060818944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839895.425187:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839895.425212:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060819072:0@lo:38:kworker.0 00000100:00100000:1.0:1788839895.425227:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060818944:12345-0@lo:400:kworker.0 Request processed in 60us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839895.425235:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788839895.425252:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788839895.425258:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839895.425262:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060818816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839895.425284:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060819200:0@lo:38:kworker.0 00000100:00100000:3.0:1788839895.428535:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060819328:0@lo:400:kworker.0 00000100:00100000:0.0:1788839895.432298:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060819712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839895.432395:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839895.432457:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060818688 00000100:00100000:0.0:1788839895.432464:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060818688 00000100:00100000:1.0:1788839895.432537:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060818816:12345-0@lo:400:kworker.0 Request processed in 7275us (7497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839895.432549:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788839895.432644:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839895.432649:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839895.432802:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060819584:0@lo:400:kworker.0 00000100:00100000:1.0:1788839895.432834:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839895.432888:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060818816:0@lo:400:kworker.0 00000100:00100000:1.0:1788839895.432900:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060818944:0@lo:400:kworker.0 00000100:00100000:0.0:1788839895.432950:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788839895.432959:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060818688:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788839895.432980:0:17119:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788839895.434875:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060819072 00000100:00100000:2.0:1788839895.434887:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060819072 00000100:00100000:2.0:1788839895.434921:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060819584 00000100:00100000:2.0:1788839895.434934:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060819584 00000100:00100000:2.0:1788839895.434990:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788839895.435000:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060819584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839895.435083:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060819584:12345-0@lo:400:kworker.0 Request processed in 84us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839895.435090:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788839895.435105:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788839895.435110:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060819072:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788839895.435127:0:17113:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788839895.435157:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060819072:12345-0@lo:38:kworker.0 Request processed in 45us (9900us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788839895.435162:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788839895.435181:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788839895.435213:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8ab777c75f80 x1875734060819584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839895.435226:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060819584:0@lo:400:kworker.0 00000100:00100000:3.0:1788839895.436122:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839895.439454:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060819712 00000100:00100000:3.0:1788839895.439467:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060819712 00000100:00100000:3.0:1788839895.439520:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788839895.439530:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060819712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788839895.439574:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788839895.439659:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060819712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (7268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839895.439666:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788839895.442456:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060819328 00000100:00100000:2.0:1788839895.442469:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060819328 00000100:00080000:2.0:1788839895.443506:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839895.443555:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788839895.443569:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060819328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839895.443665:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060819328:12345-0@lo:400:kworker.0 Request processed in 100us (7545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839895.443672:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1788839895.443717:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8ab777c74380 x1875734060819328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839895.443732:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060819328:0@lo:400:kworker.0 00000100:00100000:3.0:1788839895.449906:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060819712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839895.449970:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839895.450056:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060819456:0@lo:38:kworker.0 00000100:00100000:3.0:1788839895.450099:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788839895.450293:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab745344000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839895.450299:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788839895.450303:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060819072:0@lo:38:kworker.0 00000100:00100000:2.0:1788839895.450338:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060819200 00000100:00100000:2.0:1788839895.450345:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060819200 00000100:00100000:2.0:1788839895.450426:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060819456 00000100:00100000:2.0:1788839895.450430:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060819456 00000100:00100000:3.0:1788839895.450471:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788839895.450480:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060819200:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788839895.450499:0:17149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788839895.450546:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060819200:12345-0@lo:38:kworker.0 Request processed in 66us (576us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788839895.450553:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788839895.450572:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788839895.450575:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060819456:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788839895.450584:0:17149:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788839895.450609:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060819456:12345-0@lo:38:kworker.0 Request processed in 31us (509us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788839895.450614:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788839895.450639:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab75867c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839895.450644:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788839895.450647:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060819200:0@lo:38:kworker.0 00000100:00080000:3.0:1788839895.450656:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ac000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839895.450659:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788839895.450661:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060819456:0@lo:38:kworker.0 00000100:00100000:0.0:1788839895.460018:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060818688:12345-0@lo:38:kworker.0 Request processed in 27049us (34821us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788839895.460033:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788839895.462106:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839895.462115:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788839895.462121:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060818688:0@lo:38:kworker.0 00010000:00010000:3.0:1788839895.617919:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788839895.937077:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788839895.937086:0:19436:0:(genops.c:885:class_export_put()) final put ffff8ab647518800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839895.937161:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647518800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788839895.937217:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab64751a800 for lustre-OST0001 00000001:00100000:0.0:1788839895.937743:0:18617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788839895.937747:0:18617:0:(genops.c:885:class_export_put()) final put ffff8ab647519800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788839895.937831:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647519800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788839895.937861:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab64751b800 for lustre-OST0000 00000020:01000004:1.0:1788839896.297558:0:20887:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788839896.322012:0:20887:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788839896.322072:0:20887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.322086:0:20887:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.322094:0:20887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.322101:0:20887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.322126:0:20887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788839896.322132:0:20887:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788839896.322155:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839896.322160:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788839896.322166:0:20887:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788839896.322172:0:20887:0:(import.c:65:import_set_state_nolock()) ffff8ab745344000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788839896.322177:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839896.322178:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788839896.322181:0:20887:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788839896.322472:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839896.322479:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839896.322488:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552200 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839896.322493:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839896.322503:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839896.322510:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839896.322529:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788839896.322532:0:17101:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788839896.322535:0:17101:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788839896.322572:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839896.322578:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839896.322603:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839896.322610:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839896.322624:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839896.322626:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839896.322628:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839896.322645:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060819840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839896.323493:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839896.323574:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060819840 00000100:00100000:1.0:1788839896.323582:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060819840 00000100:00100000:1.0:1788839896.323622:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839896.323630:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3617:x1875734060819840:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788839896.323637:0:17100:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788839896 with bad export cookie 12491635415798201366 00010000:00010000:3.0:1788839896.328143:0:20887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.328162:0:20887:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.328171:0:20887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.328179:0:20887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.328237:0:20887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839896.328245:0:20887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.328251:0:20887:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.328257:0:20887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.328263:0:20887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.336454:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839896.336471:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.336484:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839896.336488:0:18648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.336521:0:18648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839896.336529:0:18648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839896.336534:0:18648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788839896.336537:0:18648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788839896.336606:0:18648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.336614:0:18648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839896.336656:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.336664:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839896.336688:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839896.336706:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060819968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839896.336788:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839896.336841:0:17099:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788839896.336850:0:17099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788839896.336868:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839896.336873:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.336880:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553000 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839896.336883:0:18648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.336897:0:18648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839896.336904:0:18648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839896.336910:0:18648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788839896.336913:0:18648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788839896.336926:0:18648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839896.336931:0:18648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839896.336940:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839896.336954:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060820096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839896.336980:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839896.337003:0:17098:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788839896.337010:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060819968 00000100:00100000:2.0:1788839896.337017:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060819968 00000100:00100000:2.0:1788839896.337040:0:17098:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788839896.337044:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060820096 00000100:00100000:2.0:1788839896.337046:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060820096 00010000:00010000:2.0:1788839896.337057:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839896.337059:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839896.337061:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839896.337997:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3617:x1875734060819840:12345-0@lo:103:ldlm_bl.0 Request processed in 14361us (14501us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788839896.338008:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788839896.338053:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788839896.338057:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788839896.338067:0:3617:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1788839896.338496:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788839896.338505:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3615:x1875734060819968:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788839896.338512:0:17099:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788839896 with bad export cookie 12491635415798201366 00000100:00100000:2.0:1788839896.338559:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3615:x1875734060819968:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (1788us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788839896.338566:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788839896.338586:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788839896.338591:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3615:x1875734060820096:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788839896.338595:0:17099:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788839896 with bad export cookie 12491635415798201366 00000100:00100000:2.0:1788839896.338622:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3615:x1875734060820096:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (1641us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788839896.338627:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788839896.338913:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1788839896.339097:0:20887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788839896.339106:0:20887:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839896.339138:0:20887:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788839896.339148:0:20887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.339156:0:20887:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.339163:0:20887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.339170:0:20887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.339186:0:20887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839896.339192:0:20887:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.339198:0:20887:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.339205:0:20887:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.339210:0:20887:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.339221:0:20887:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788839896.339224:0:20887:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1788839896.339228:0:20887:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788839896.339270:0:20887:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788839896.339275:0:20887:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788839896.339279:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839896.339285:0:20887:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788839896.339290:0:20887:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8ab64751c000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788839896.339296:0:20887:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8ab64663d000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788839896.339301:0:20887:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8ab7486e99b8) has exports, disconnecting them 00000020:00080000:3.0:1788839896.339305:0:20887:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ab64751c000), last request at 1788839895 00000020:00000080:3.0:1788839896.339311:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573f65 00000100:00080000:3.0:1788839896.339327:0:20887:0:(import.c:65:import_set_state_nolock()) ffff8ab64751f800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788839896.339383:0:20887:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab64751c000): rc 0 00000020:00000080:3.0:1788839896.339386:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab64751c000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788839896.339395:0:20887:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ab64663d000), last request at 1788839895 00000020:00000080:3.0:1788839896.339399:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573ecb 00000100:00080000:3.0:1788839896.339405:0:20887:0:(import.c:65:import_set_state_nolock()) ffff8ab646638000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788839896.339410:0:20887:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab64663d000): rc 0 00000020:00000080:3.0:1788839896.339412:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab64663d000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788839896.339419:0:20887:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb69880c8fae0 00000100:00080000:3.0:1788839896.339436:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788839896.339439:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788839896.341930:0:20887:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788839896.341941:0:20887:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788839896.342043:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839896.342052:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839896.342064:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958a00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839896.342068:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839896.342077:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839896.342085:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839896.342113:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788839896.342115:0:17102:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788839896.342119:0:17102:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788839896.346748:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839896.346761:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.346788:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfde00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839896.346794:0:18648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.346821:0:18648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839896.346830:0:18648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839896.346836:0:18648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788839896.346839:0:18648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788839896.346842:0:18648:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:1.0:1788839896.349114:0:3617:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.152@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788839896.349120:0:3617:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788839896.349130:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab744357100 x1875734060818560/t0(0) o400->MGC192.168.203.152@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788839911 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839896.349144:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab646b4df80 x1875734060819840/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788839912 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839896.349152:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab744354a80 x1875734060819968/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788839912 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839896.349160:0:3617:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab7819fa300 x1875734060820096/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788839912 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788839896.349168:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788839896.349170:0:3617:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788839896.349172:0:3617:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788839896.349485:0:3615:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ab646b3a800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1788839896.349513:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060819968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839896.349523:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060818560:0@lo:400:kworker.0 00000100:00100000:2.0:1788839896.349561:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060820096:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1788839896.349585:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64751c000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1788839896.349647:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64663d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1788839896.349667:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab64751f800 for lustre-MDT0001 00000020:00000080:2.0:1788839896.349672:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646638000 for lustre-MDT0001 00010000:00010000:2.0:1788839896.349893:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839896.349965:0:17102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839896.349976:0:17102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788839896.350021:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:0:1875734060820224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839896.350049:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839896.350058:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839896.350072:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839896.350074:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839896.350076:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839896.350172:0:18648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.350179:0:18648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788839896.350208:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788839896.350223:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.350230:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839896.350245:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839896.350247:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839896.350249:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788839896.350274:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788839896.350281:0:3617:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 458 00000100:00080000:1.0:1788839896.350289:0:3617:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff8ab646b3a800 using connection 192.168.203.152@tcp/0@lo 00000100:00080000:3.0:1788839896.350494:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788839896.350498:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788839896.350516:0:20887:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788839896.350568:0:20887:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788839896.350582:0:20887:0:(import.c:65:import_set_state_nolock()) ffff8ab648168000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788839896.350594:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788839896.350596:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788839896.350616:0:20887:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788839896.350743:0:20887:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788839896.350754:0:20887:0:(import.c:65:import_set_state_nolock()) ffff8ab646b66800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788839896.350818:0:20887:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ab7486e99b8) has no exports 00000100:00100000:1.0:1788839896.350998:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4e680 x1875734060820736/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839896.351019:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060819840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839896.351083:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:0:1875734060820352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839896.351101:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060820480:0@lo:9:umount.0 00000100:00100000:2.0:1788839896.351159:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839896.351234:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060820608:0@lo:9:umount.0 00000100:00100000:2.0:1788839896.351257:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839896.351844:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4b73860-6950-4a5d-8d03-52a643e5ff43:3613:1875734060820736:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788839896.351865:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875734060820736 offset 0 length 520: 4 00000100:00100000:0.0:1788839896.351966:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060820480 00000100:00100000:0.0:1788839896.351974:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060820480 00000100:00100000:0.0:1788839896.352014:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060820608 00000100:00100000:0.0:1788839896.352016:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060820608 00000100:00100000:0.0:1788839896.352035:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839896.352043:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1875734060820480:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788839896.352067:0:18622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573ef5 00000100:00080000:0.0:1788839896.352077:0:18622:0:(import.c:65:import_set_state_nolock()) ffff8ab64663e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788839896.352113:0:18622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1788839896.352245:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3613:x1875734060820480:12345-0@lo:9:umount.0 Request processed in 202us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839896.352252:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839896.352267:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788839896.352284:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1875734060820608:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788839896.352295:0:18622:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573f9d 00000100:00080000:0.0:1788839896.352300:0:18622:0:(import.c:65:import_set_state_nolock()) ffff8ab64751f000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788839896.352320:0:18622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788839896.352530:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3613:x1875734060820608:12345-0@lo:9:umount.0 Request processed in 246us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839896.352537:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788839896.352553:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839896.352729:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab648168000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1788839896.352834:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788839896.352862:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788839896.352971:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788839896.352976:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060820480:0@lo:9:umount.0 00000100:00080000:2.0:1788839896.352990:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646b66800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788839896.353004:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788839896.353005:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788839896.353008:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060820608:0@lo:9:umount.0 00000020:00080000:3.0:1788839896.358011:0:20887:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ab7486e99b8) has no exports 00000020:01000000:2.0:1788839896.424622:0:20887:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6464423c0 - data ffff8ab7526b55e8/ffff8ab781efc400 00000020:01000000:2.0:1788839896.425115:0:20887:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab646625f60 - data ffff8ab75f1d1510/ffff8ab74f347000 00000001:00000004:2.0:1788839896.435012:0:20887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1788839896.491460:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788839896.491470:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788839896.491479:0:20887:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788839896.493489:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788839896.493495:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788839896.493596:0:20887:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839896.493599:0:20887:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788839896.496091:0:17855:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788839896.496098:0:17855:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:2.0:1788839896.496109:0:17855:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788839896.497422:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788839896.497428:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788839896.497456:0:20887:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788839896.497459:0:20887:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788839896.498037:0:17857:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788839896.498041:0:17857:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1788839896.498052:0:17857:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788839896.499686:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573d5f 00000020:00000080:3.0:1788839896.499699:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab7487dd000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788839896.500686:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573d74 00000020:00000080:3.0:1788839896.500695:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab753b7c000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788839896.500702:0:20887:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788839896.500707:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839896.500715:0:20887:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788839896.500719:0:20887:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ab7486ecd28) has no exports 00000004:01000000:3.0:1788839896.501006:0:20887:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788839896.501014:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573dc8 00000020:00000080:3.0:1788839896.501019:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab64816c800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788839896.501022:0:20887:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788839896.501027:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839896.501032:0:20887:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788839896.501034:0:20887:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8ab6479a0000) has no exports 00000020:00000080:3.0:1788839896.501039:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573dc1 00000020:00000080:3.0:1788839896.501042:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab646b60000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788839896.501368:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7487dd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788839896.501376:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab753b7c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1788839896.501381:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64816c800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788839896.501385:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b60000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788839896.501743:0:20887:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788839896.501748:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788839896.501752:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788839896.501757:0:20887:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788839896.501759:0:20887:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788839896.502075:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839896.502082:0:20887:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788839896.502089:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573db3 00000020:00000080:3.0:1788839896.502096:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab64816b800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788839896.502457:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646b66800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788839896.502466:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab64816b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788839896.502474:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64816b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788839896.502481:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788839896.502674:0:20887:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788839896.502679:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839896.502685:0:20887:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788839896.502689:0:20887:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8ab7487d4d28) has no exports 00000020:00000080:3.0:1788839896.502695:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573da5 00000020:00000080:3.0:1788839896.502700:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab64816d800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788839896.503216:0:20887:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788839896.503220:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788839896.503224:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1788839896.503228:0:20887:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788839896.503230:0:20887:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788839896.503256:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839896.503262:0:20887:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788839896.503273:0:20887:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788839896.503278:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573d97 00000020:00000080:3.0:1788839896.503282:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab64816f000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788839896.503286:0:20887:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788839896.503291:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839896.503294:0:20887:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788839896.503297:0:20887:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8ab777fb19b8) has no exports 00000020:00000080:3.0:1788839896.503301:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573d90 00000020:00000080:3.0:1788839896.503304:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab77e441800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788839896.509059:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64816b800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788839896.509074:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64816d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788839896.509080:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab648168000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788839896.509088:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab64816d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788839896.509091:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64816d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788839896.509095:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788839896.509179:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64816f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788839896.509184:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e441800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788839896.509849:0:20887:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788839896.509855:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839896.509860:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788839896.509867:0:20887:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839896.510037:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839896.510048:0:20887:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788839896.510074:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839896.510077:0:20887:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788839896.510081:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab7487db000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788839896.510083:0:20887:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7487db000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788839896.510089:0:20887:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788839896.510119:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab77e444800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788839896.510126:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab7487d9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788839896.510128:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7487d9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788839896.510136:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788839896.510877:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573d7b 00000020:00000080:2.0:1788839896.510886:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab753b7f800/lustre-MDD0001_UUID 00000020:01000000:2.0:1788839896.511534:0:20887:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788839896.511541:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839896.511548:0:20887:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788839896.511553:0:20887:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ab77e4fb370) has no exports 00000020:00000080:2.0:1788839896.511576:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839896.511581:0:20887:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788839896.511597:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573d82 00000020:00000080:2.0:1788839896.511602:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab753b7c800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788839896.511613:0:20887:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab7479d8000 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788839896.511616:0:20887:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab7479d8000 2 00000020:01000004:2.0:1788839896.511620:0:20887:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab7479d8000 from lustre-MDT0001 00000020:00000080:2.0:1788839896.511642:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839896.511646:0:20887:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788839896.511648:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab7487d9000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788839896.511651:0:20887:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7487d9000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788839896.511662:0:20887:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788839896.511716:0:20887:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788839896.511721:0:20887:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788839896.511724:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839896.511728:0:20887:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788839896.511736:0:20887:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8ab648169800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788839896.511742:0:20887:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8ab7487d19b8) has exports, disconnecting them 00000020:00080000:2.0:1788839896.511748:0:20887:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8ab648169800), last request at 1788839817 00000020:00000080:2.0:1788839896.511752:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573e00 00000020:00080000:2.0:1788839896.511767:0:20887:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab648169800): rc 0 00000020:00000080:2.0:1788839896.511795:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab648169800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788839896.511954:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab753b7f800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788839896.511959:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab7487de800/lustre-MDD0001_UUID 00000020:00000080:0.0:1788839896.511961:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7487de800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788839896.511966:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788839896.512095:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab753b7c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788839896.512100:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab648169800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788839896.530841:0:20887:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788839896.530850:0:20887:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788839896.530854:0:20887:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788839896.530873:0:20887:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788839896.530930:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab745344000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788839896.531175:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839896.531184:0:20887:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788839896.531203:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab7487dd800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788839896.531207:0:20887:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7487dd800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788839896.531220:0:20887:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788839896.531296:0:20887:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab7479d8000 1 00000020:00000080:0.0:1788839896.531303:0:20887:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573d27 00000020:00000080:0.0:1788839896.531309:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab777b44800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788839896.531318:0:20887:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788839896.531326:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab777b44800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788839896.531337:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839896.531342:0:20887:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788839896.531346:0:20887:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8ab777fb0000) has no exports 00010000:00010000:3.0:1788839896.639921:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788839896.723706:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839896.723991:0:20887:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788839896.723997:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab7479dc000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788839896.724001:0:20887:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7479dc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788839896.724013:0:20887:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788839896.724134:0:20887:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab7479da800 00000020:01000000:1.0:1788839896.724156:0:20887:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788839896.724160:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839896.724173:0:20887:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788839896.724177:0:20887:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ab777fb3370) has no exports 00000100:00100000:3.0:1788839896.724872:0:17113:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8ab753c63a00:17113] 0 exiting: rc = 1 00000100:00100000:3.0:1788839896.725002:0:17149:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8ab74860f600:17149] 3 exiting: rc = 0 00000100:00100000:3.0:1788839896.725067:0:17115:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8ab647598200:17115] 2 exiting: rc = 0 00000100:00100000:3.0:1788839896.725145:0:17114:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8ab647598c00:17114] 1 exiting: rc = 0 00000100:00100000:3.0:1788839896.725212:0:20599:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8ab6477c8a00:20599] 4 exiting: rc = 0 00000100:00100000:3.0:1788839896.725285:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725292:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725297:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725303:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725308:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725313:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725318:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725323:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725328:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725333:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725339:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725345:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725350:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725366:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725372:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725378:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725383:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725388:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725393:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725398:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725404:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725409:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725414:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725419:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725424:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725430:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725435:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725441:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725446:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725452:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725457:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725462:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725468:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725473:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725478:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725491:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725496:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725502:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725507:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725512:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725518:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725523:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725528:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725533:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725539:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725545:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725550:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725555:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725561:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725566:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725572:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725577:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725582:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725587:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725593:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725599:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725605:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725611:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725617:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725622:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725627:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725632:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725637:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.725643:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729257:0:17116:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8ab7766c9600:17116] 0 exiting: rc = 1 00000100:00100000:1.0:1788839896.729435:0:17117:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8ab7766c8a00:17117] 1 exiting: rc = 0 00000100:00100000:3.0:1788839896.729639:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729648:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729654:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729660:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729665:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729683:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729688:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729693:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729698:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729702:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729707:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729713:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729718:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729723:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729728:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729732:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729737:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729742:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729746:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729750:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729755:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729760:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729764:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729801:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729807:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729812:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729816:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729822:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729826:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729831:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729836:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729841:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729845:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729851:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729856:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729860:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729865:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729869:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729874:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729879:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729891:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729895:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729900:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.729999:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730006:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730011:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730016:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730021:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730026:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730032:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730037:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730042:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730046:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730051:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730056:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730061:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730066:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730071:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730077:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730083:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730091:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730096:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730101:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730106:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730520:0:17118:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8ab77e49e600:17118] 0 exiting: rc = 1 00000100:00100000:1.0:1788839896.730650:0:18138:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8ab746ac2800:18138] 2 exiting: rc = 0 00000100:00100000:2.0:1788839896.730788:0:17119:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8ab64690e000:17119] 1 exiting: rc = 0 00000100:00100000:3.0:1788839896.730878:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730886:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730891:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730898:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730974:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730982:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730987:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.730993:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731014:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731021:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731035:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731040:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731046:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731052:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731057:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731063:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731069:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731075:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731081:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731086:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731105:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731112:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731119:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731124:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731132:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731140:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731146:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731153:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731160:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731167:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731173:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731179:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731201:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731208:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731213:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731219:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731225:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731232:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731238:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731244:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731250:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731256:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731262:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731268:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731288:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731301:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731307:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731313:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731321:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731327:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731334:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731342:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731348:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731367:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731376:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731384:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731407:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731414:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731420:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731425:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731432:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731437:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731443:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.731448:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839896.740244:0:17121:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8ab744c38c00:17121] 1 exiting: rc = 0 00000100:00100000:2.0:1788839896.740403:0:17120:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8ab744c38800:17120] 0 exiting: rc = 1 00000100:00100000:0.0:1788839896.740577:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740585:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740590:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740596:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740602:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740607:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740612:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740617:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740622:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740628:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740633:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740639:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740644:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740650:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740655:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740661:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740666:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740682:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740688:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740692:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740698:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740702:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740707:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740712:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740717:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740722:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740727:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740732:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740737:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740742:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740746:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740751:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740756:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740761:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.740766:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741020:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741026:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741032:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741037:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741043:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741049:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741054:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741060:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741066:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741071:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741077:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741082:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741087:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741092:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741097:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741102:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741107:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741121:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741126:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741132:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741137:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741142:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741147:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741152:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741157:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741162:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741167:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741171:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.741177:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.741551:0:17122:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8ab641ae8800:17122] 0 exiting: rc = 1 00000100:00100000:2.0:1788839896.743395:0:17123:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8ab641ae9600:17123] 1 exiting: rc = 0 00000100:00100000:0.0:1788839896.745635:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745646:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745651:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745657:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745662:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745667:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745672:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745678:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745683:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745688:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745693:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745699:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745704:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745709:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745715:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745720:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745725:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745730:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745736:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745741:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745747:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745752:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745757:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745790:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745795:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745800:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745805:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745809:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745814:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745819:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745824:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745829:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745834:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.745838:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.746957:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.746973:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.746980:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.746985:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.746991:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.746996:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747002:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747007:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747012:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747017:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747022:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747027:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747032:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747038:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747042:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747047:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747052:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747057:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747062:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747066:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747071:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747077:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747081:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747086:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747104:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747109:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747114:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747119:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747124:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747129:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.747554:0:17124:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8ab64669da00:17124] 0 exiting: rc = 1 00000100:00100000:2.0:1788839896.749002:0:17125:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8ab64669ca00:17125] 1 exiting: rc = 0 00000100:00100000:0.0:1788839896.749253:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749260:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749265:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749270:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749275:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749280:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749285:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749289:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749295:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749300:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749304:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749309:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749315:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749320:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749326:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749330:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749335:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749340:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749346:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749351:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749368:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749373:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749378:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749384:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749388:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749393:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749398:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749404:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749421:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749426:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749431:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749436:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749441:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749445:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749450:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749455:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749461:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749466:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749470:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749474:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749478:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749483:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749488:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749492:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749496:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749501:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749506:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749511:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749516:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749520:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749525:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749530:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749535:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749540:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749544:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749549:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749554:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749559:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749563:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749568:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749573:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749577:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749582:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839896.749594:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839896.753642:0:17126:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8ab74469e400:17126] 0 exiting: rc = 1 00000100:00100000:2.0:1788839896.755578:0:17127:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8ab74469fa00:17127] 1 exiting: rc = 0 00000100:00100000:0.0:1788839896.757027:0:17128:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8ab646866200:17128] 2 exiting: rc = 0 00000100:00100000:1.0:1788839896.757403:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757412:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757417:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757424:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757429:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757437:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757451:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757458:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757463:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757469:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757475:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757481:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757487:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757493:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757499:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757506:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757512:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757518:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757523:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757529:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757534:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757541:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757546:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757561:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757568:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757574:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757580:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757586:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757591:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757610:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757616:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757622:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757629:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757635:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757641:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757647:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757653:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757659:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757665:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757671:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757676:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757682:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757687:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757693:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757697:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757703:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757709:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757727:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757733:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757739:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757744:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757750:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757755:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757760:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757766:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757791:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757798:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757803:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757809:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757815:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757820:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757828:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757834:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839896.757840:0:20887:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788839896.764508:0:20887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839896.764521:0:20887:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788839896.764526:0:20887:0:(genops.c:885:class_export_put()) final put ffff8ab646b3d800/MDS_uuid 00000020:00000080:2.0:1788839896.764530:0:20887:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b3d800/MDS_uuid for MDS 00000020:01000000:2.0:1788839896.764545:0:20887:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788839896.764664:0:20887:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788839897.663963:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839898.688911:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839899.714598:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788839900.529514:0:21088:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000100:00080000:0.0:1788839900.542891:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839900.542901:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839900.542904:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839900.542908:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788839900.542913:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab75867c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839900.542920:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 550 00000100:00080000:0.0:1788839900.542926:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788839900.542935:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab75867c000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839900.542979:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6476b0e00 x1875734060820864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839900.543037:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839900.543041:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788839900.543044:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ac000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839900.543048:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 550 00000100:00080000:0.0:1788839900.543050:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788839900.543055:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab6475ac000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839900.543057:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060820992:0@lo:400:kworker.0 00000100:00100000:0.0:1788839900.543069:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6476b1c00 x1875734060821120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839900.543105:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060821248:0@lo:400:kworker.0 00000400:00000100:1.0:1788839900.543117:0:3614:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060820992 offset 0 length 224: 4 00000400:00000100:0.0:1788839900.543139:0:3615:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060821248 offset 0 length 224: 4 00000100:00100000:2.0:1788839900.543240:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060820864:0@lo:38:kworker.0 00000400:00000100:2.0:1788839900.543279:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060820864 offset 0 length 520: 4 00000100:00100000:2.0:1788839900.543299:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060821120:0@lo:38:kworker.0 00000400:00000100:2.0:1788839900.543315:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060821120 offset 0 length 520: 4 00000020:01000004:1.0:1788839900.547545:0:21088:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788839900.547601:0:21088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839900.547618:0:21088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839900.547625:0:21088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839900.547632:0:21088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839900.547659:0:21088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788839900.547665:0:21088:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788839900.547688:0:21088:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788839900.547700:0:21088:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6476b0e00 x1875734060820864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788839920 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839900.547723:0:21088:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788839900.547730:0:21088:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788839900.547736:0:21088:0:(import.c:65:import_set_state_nolock()) ffff8ab75867c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788839900.547740:0:21088:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788839900.547744:0:21088:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6476b0e00 x1875734060820864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788839920 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839900.547750:0:21088:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788839900.547753:0:21088:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 26s for inflight to error out 00010000:00010000:0.0:1788839900.550209:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839900.550225:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839900.550261:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842a00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839900.550266:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839900.550276:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839900.550282:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839900.550287:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788839900.550290:0:17102:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788839900.550293:0:17102:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788839900.550310:0:17102:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab646b3a800 00010000:00010000:0.0:1788839900.550313:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839900.550319:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839900.550343:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839900.550345:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839900.550347:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839900.551699:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060820864:0@lo:38:kworker.0 00000100:00080000:1.0:1788839900.552547:0:21088:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788839900.552560:0:21088:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6476b1f80 x1875734060820992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839916 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839900.552582:0:21088:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788839900.552587:0:21088:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788839900.552611:0:21088:0:(import.c:65:import_set_state_nolock()) ffff8ab7766f3800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788839900.552692:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875734060821376:0@lo:39:umount.0 00000400:00000100:2.0:1788839900.552739:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060821376 offset 0 length 224: 4 00000100:00100000:0.0:1788839900.553406:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060820992:0@lo:400:kworker.0 00010000:00010000:3.0:1788839900.734955:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788839901.567029:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788839901.567037:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839901.567039:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788839901.567043:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839901.567206:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839901.567228:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060821504:0@lo:400:kworker.0 00000400:00000100:3.0:1788839901.567284:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060821504 offset 0 length 224: 4 00010000:00010000:3.0:1788839901.759103:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788839902.083223:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788839902.083436:0:19436:0:(genops.c:885:class_export_put()) final put ffff8ab64751e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788839902.084792:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64751e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788839902.085135:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab64751f000 for lustre-OST0001 00000001:00100000:0.0:1788839902.086105:0:18617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788839902.086111:0:18617:0:(genops.c:885:class_export_put()) final put ffff8ab64663f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788839902.086196:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64663f800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788839902.097577:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab64663e000 for lustre-OST0000 00010000:00010000:0.0:1788839902.783067:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839903.807207:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839904.830964:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788839905.599423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839905.599460:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839905.599464:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839905.599467:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788839905.599617:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839905.599647:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060821632:0@lo:400:kworker.0 00000400:00000100:2.0:1788839905.599716:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060821632 offset 0 length 224: 4 00010000:00010000:0.0:1788839905.855050:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839906.690817:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839896/real 1788839896] req@ffff8ab646b4e680 x1875734060820736/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788839906 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839906.690851:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab646b4e680 x1875734060820736/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788839906 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788839906.690870:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3a800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788839906.690896:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788839906.690900:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4b73860-6950-4a5d-8d03-52a643e5ff43:3613:1875734060820736:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:0.0:1788839906.690983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839906.690988:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788839906.690991:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839906.690996:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 551 00000100:00080000:0.0:1788839906.691001:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.152@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839906.691008:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff8ab646b3a800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839906.691040:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6476b3100 x1875734060821760/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839906.691064:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839906.691069:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839906.691165:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839906.691178:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060821888:0@lo:400:kworker.0 00000400:00000100:3.0:1788839906.691239:0:3615:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060821888 offset 0 length 224: 4 00000100:00100000:1.0:1788839906.692040:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4b73860-6950-4a5d-8d03-52a643e5ff43:3613:1875734060821760:0@lo:250:kworker.0 00000400:00000100:1.0:1788839906.692072:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875734060821760 offset 0 length 520: 4 00010000:00010000:3.0:1788839906.879969:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839907.903414:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839908.929369:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839909.952502:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839910.782894:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839900/real 1788839900] req@ffff8ab646b4df80 x1875734060821376/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839910 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839910.782940:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab646b4df80 x1875734060821376/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839910 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788839910.782961:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab7766f3800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788839910.782984:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875734060821376:0@lo:39:umount.0 00000100:00080000:2.0:1788839910.783976:0:21088:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788839910.783986:0:21088:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788839910.783995:0:21088:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788839910.787855:0:21088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839910.787882:0:21088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839910.789007:0:21088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839910.789031:0:21088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839910.789098:0:21088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839910.789121:0:21088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839910.789129:0:21088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839910.789136:0:21088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839910.789143:0:21088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839910.789164:0:21088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788839910.789170:0:21088:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1788839910.789195:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839910.789215:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788839910.789219:0:21088:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00010000:00010000:0.0:1788839910.789222:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:01000000:2.0:1788839910.789231:0:21088:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:0.0:1788839910.789235:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839910.789237:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959200 already unused, calling callback (ffffffffc1387c20) 00000020:00000080:2.0:1788839910.789241:0:21088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:3.0:1788839910.789247:0:18648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788839910.789252:0:21088:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1788839910.789254:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839910.789275:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788839910.789277:0:21088:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8ab646694d28) has no exports 00010000:00010000:3.0:1788839910.789282:0:18648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839910.789298:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839910.789308:0:18648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839910.789316:0:18648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00080000:2.0:1788839910.789316:0:21088:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8ab646694d28) has no exports 10000000:01000000:3.0:1788839910.789325:0:18648:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788839910.789330:0:18648:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:00010000:0.0:1788839910.789334:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839910.789342:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788839910.789345:0:17102:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788839910.789348:0:17102:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788839910.789353:0:18648:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab646b3a800 00010000:00010000:3.0:1788839910.789359:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839910.789359:0:17102:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab646b3a800 00010000:00010000:0.0:1788839910.789364:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839910.789371:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839910.789375:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839910.789397:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839910.789398:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839910.789401:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839910.789402:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839910.789406:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839910.789412:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788839910.796588:0:21088:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab75e765600 - data ffff8ab75f1e16c0/ffff8ab6410a2800 00000020:01000000:3.0:1788839910.796817:0:21088:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab7487c5ea0 - data ffff8ab7526ec288/ffff8ab746a4b800 00100000:10000000:3.0:1788839910.817721:0:21088:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788839910.833719:0:21088:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573e85 00000020:00000080:1.0:1788839910.833738:0:21088:0:(genops.c:885:class_export_put()) final put ffff8ab6475af000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788839910.833765:0:21088:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab75e47c000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788839910.833790:0:21088:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab75e47c000 2 00000020:01000004:1.0:1788839910.833794:0:21088:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab75e47c000 from lustre-OST0000 00000020:00000080:1.0:1788839910.833822:0:21088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839910.833834:0:21088:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788839910.833837:0:21088:0:(genops.c:885:class_export_put()) final put ffff8ab6475aa000/lustre-OST0000_UUID 00000020:00000080:1.0:1788839910.833840:0:21088:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6475aa000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788839910.833847:0:21088:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788839910.833933:0:21088:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788839910.833938:0:21088:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788839910.833942:0:21088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839910.833947:0:21088:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788839910.833954:0:21088:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ab7766f7000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839910.833960:0:21088:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8ab6479e8000) has exports, disconnecting them 00000020:00080000:1.0:1788839910.833966:0:21088:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ab7766f7000), last request at 1788839831 00000020:00000080:1.0:1788839910.833970:0:21088:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573eaf 00000020:00080000:1.0:1788839910.833980:0:21088:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab7766f7000): rc 0 00000020:00000080:1.0:1788839910.833986:0:21088:0:(genops.c:885:class_export_put()) final put ffff8ab7766f7000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788839910.834879:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6475af000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788839910.834895:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7766f7000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788839910.834918:0:21088:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788839910.834924:0:21088:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788839910.834929:0:21088:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788839910.834935:0:21088:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839910.835007:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab75867c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788839910.835130:0:21088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839910.835138:0:21088:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788839910.835153:0:21088:0:(genops.c:885:class_export_put()) final put ffff8ab647b15800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788839910.835156:0:21088:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647b15800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788839910.835166:0:21088:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788839910.835286:0:21088:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788839910.835290:0:21088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839910.835294:0:21088:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788839910.835301:0:21088:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8ab7766f5000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788839910.835319:0:21088:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8ab7487d3370) has exports, disconnecting them 00000020:00080000:0.0:1788839910.835324:0:21088:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8ab7766f5000), last request at 1788839831 00000020:00000080:0.0:1788839910.835328:0:21088:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573ec4 00000020:00080000:0.0:1788839910.835342:0:21088:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab7766f5000): rc 0 00000020:00000080:0.0:1788839910.835347:0:21088:0:(genops.c:885:class_export_put()) final put ffff8ab7766f5000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788839910.835383:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7766f5000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788839910.870933:0:21088:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788839910.870947:0:21088:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788839910.870953:0:21088:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788839910.870983:0:21088:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839910.871028:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab7766f3800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788839910.871300:0:21088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839910.871310:0:21088:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788839910.871317:0:21088:0:(genops.c:885:class_export_put()) final put ffff8ab7766f6000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788839910.871322:0:21088:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7766f6000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788839910.871333:0:21088:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788839910.871416:0:21088:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab75e47c000 1 00000020:00000080:2.0:1788839910.871423:0:21088:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573e62 00000020:00000080:2.0:1788839910.871432:0:21088:0:(genops.c:885:class_export_put()) final put ffff8ab75867f000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788839910.871442:0:21088:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788839910.871451:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab75867f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788839910.871460:0:21088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839910.871466:0:21088:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788839910.871470:0:21088:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8ab6466919b8) has no exports 00000020:00000080:2.0:1788839910.942709:0:21088:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839910.942725:0:21088:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788839910.942732:0:21088:0:(genops.c:885:class_export_put()) final put ffff8ab75e47b000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788839910.942738:0:21088:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab75e47b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788839910.942752:0:21088:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788839910.942928:0:21088:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab75e47b800 00000020:02000400:2.0:1788839910.942975:0:21088:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788839910.983421:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788839911.810238:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788839911.810248:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839911.810261:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788839911.810264:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839911.810380:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060822016:0@lo:400:kworker.0 00000400:00000100:3.0:1788839911.810467:0:3615:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060822016 offset 0 length 224: 4 00010000:00010000:0.0:1788839912.002202:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839913.023886:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788839913.904343:0:21290:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788839913.916977:0:21290:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788839913.917059:0:21290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839913.917074:0:21290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839913.917081:0:21290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839913.917099:0:21290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839913.917154:0:21290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788839913.917173:0:21290:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788839913.917196:0:21290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788839913.917206:0:21290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6476b1c00 x1875734060821120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788839920 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839913.917233:0:21290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788839913.917248:0:21290:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788839913.917254:0:21290:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ac000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788839913.917259:0:21290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788839913.917263:0:21290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6476b1c00 x1875734060821120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788839920 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839913.917269:0:21290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788839913.917272:0:21290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1788839913.917576:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060821120:0@lo:38:kworker.0 00000100:00080000:3.0:1788839913.918609:0:21290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788839913.918621:0:21290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6476b1180 x1875734060821248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839916 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839913.918697:0:21290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab646b4fb80 x1875734060821504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839917 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839913.918722:0:21290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6476b1f80 x1875734060821632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839921 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839913.918733:0:21290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab6476b3b80 x1875734060821888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839922 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839913.918742:0:21290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab7443d8380 x1875734060822016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839927 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839913.918748:0:21290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788839913.918753:0:21290:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788839913.918800:0:21290:0:(import.c:65:import_set_state_nolock()) ffff8ab647519000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788839913.918879:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060821632:0@lo:400:kworker.0 00000100:00100000:2.0:1788839913.918903:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060821504:0@lo:400:kworker.0 00000100:00100000:2.0:1788839913.918916:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875734060822144:0@lo:39:umount.0 00000400:00000100:2.0:1788839913.918952:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060822144 offset 0 length 224: 4 00010000:00010000:0.0:1788839913.919049:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839913.919057:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839913.919066:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843e00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839913.919068:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839913.919076:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839913.919081:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839913.919084:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788839913.919093:0:17101:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788839913.919095:0:17101:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788839913.919106:0:17101:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab646b3a800 00010000:00010000:0.0:1788839913.919108:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839913.919113:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839913.919382:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060821248:0@lo:400:kworker.0 00000100:00100000:1.0:1788839913.919410:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060822016:0@lo:400:kworker.0 00000100:00100000:1.0:1788839913.919424:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060821888:0@lo:400:kworker.0 00010000:00010000:1.0:1788839913.919440:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839913.919442:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839913.919443:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839914.048404:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839915.070926:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839916.095757:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788839916.927122:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788839916.927129:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788839917.121620:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839918.142894:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839919.167884:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839920.193275:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839921.087035:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839906/real 1788839906] req@ffff8ab6476b3100 x1875734060821760/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788839921 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839921.087092:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab6476b3100 x1875734060821760/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788839921 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839921.087111:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3a800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839921.087138:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788839921.087142:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4b73860-6950-4a5d-8d03-52a643e5ff43:3613:1875734060821760:0@lo:250:kworker.0 00000100:00080000:1.0:1788839921.088230:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788839921.088237:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788839921.088240:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788839921.088245:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 561 00000100:00080000:1.0:1788839921.088251:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.152@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788839921.088257:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff8ab646b3a800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839921.088290:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4df80 x1875734060822272/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839921.096380:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4b73860-6950-4a5d-8d03-52a643e5ff43:3613:1875734060822272:0@lo:250:kworker.0 00000400:00000100:2.0:1788839921.096440:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875734060822272 offset 0 length 520: 4 00010000:00010000:3.0:1788839921.214926:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839922.239191:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839923.134910:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839913/real 1788839913] req@ffff8ab7443d9c00 x1875734060822144/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839923 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839923.134943:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab7443d9c00 x1875734060822144/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839923 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839923.134962:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647519000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788839923.134977:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875734060822144:0@lo:39:umount.0 00000100:00080000:3.0:1788839923.135204:0:21290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788839923.135209:0:21290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788839923.135214:0:21290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788839923.136158:0:21290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839923.136172:0:21290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839923.136190:0:21290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839923.136196:0:21290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839923.138949:0:21290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839923.138971:0:21290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839923.138982:0:21290:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839923.138990:0:21290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839923.138996:0:21290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839923.142801:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839923.142816:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839923.142827:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839923.142831:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839923.142841:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839923.142857:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839923.142863:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788839923.142866:0:17102:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788839923.142880:0:17102:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab646b3a800 00010000:00010000:0.0:1788839923.142884:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839923.142889:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839923.142907:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839923.142911:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839923.142946:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839923.142949:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839923.142955:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839923.142960:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839923.142965:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788839923.142967:0:17102:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788839923.142972:0:17102:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab646b3a800 00010000:00010000:0.0:1788839923.142974:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839923.142981:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839923.142983:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839923.142985:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839923.143184:0:21290:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788839923.143198:0:21290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839923.143213:0:21290:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788839923.143218:0:21290:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788839923.143221:0:21290:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788839923.143266:0:21290:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788839923.143270:0:21290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788839923.143276:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839923.143282:0:21290:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788839923.143286:0:21290:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8ab646690000) has no exports 00000020:00080000:3.0:1788839923.143309:0:21290:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8ab646690000) has no exports 00010000:00010000:2.0:1788839923.145345:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788839923.148731:0:21290:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab75e765f60 - data ffff8ab75f0ba0d8/ffff8ab6410a3400 00000020:01000000:3.0:1788839923.149113:0:21290:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab646442b40 - data ffff8ab75f298af8/ffff8ab781e9a000 00100000:10000000:3.0:1788839923.163378:0:21290:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788839923.177985:0:21290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573f1f 00000020:00000080:3.0:1788839923.177998:0:21290:0:(genops.c:885:class_export_put()) final put ffff8ab647a07800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788839923.178021:0:21290:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab778bee800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788839923.178026:0:21290:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab778bee800 2 00000020:01000004:3.0:1788839923.178029:0:21290:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab778bee800 from lustre-OST0001 00000020:00000080:3.0:1788839923.178065:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839923.178075:0:21290:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788839923.178078:0:21290:0:(genops.c:885:class_export_put()) final put ffff8ab647a06800/lustre-OST0001_UUID 00000020:00000080:3.0:1788839923.178081:0:21290:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a06800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788839923.178088:0:21290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788839923.178498:0:21290:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS 00010000:00010000:3.0:1788839923.178513:0:21290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647bfcc00/0xad5b343a26573d2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573d35 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839923.178525:0:21290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647bfcc00/0xad5b343a26573d2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573d35 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839923.178545:0:21290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788839923.178548:0:21290:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788839923.178551:0:21290:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788839923.178570:0:21290:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab646b3a800 00010000:00010000:3.0:1788839923.178574:0:21290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647bfcc00/0xad5b343a26573d2e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26573d35 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839923.178656:0:21290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839923.178664:0:21290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839923.178669:0:21290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788839923.178672:0:21290:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788839923.178674:0:21290:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788839923.178700:0:21290:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab646b3a800 00010000:00010000:3.0:1788839923.178704:0:21290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788839923.178723:0:21290:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3a800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788839923.178726:0:21290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788839923.178728:0:21290:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788839923.178730:0:21290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788839923.178734:0:21290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788839923.178743:0:21290:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab646b4df80 x1875734060822272/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788839941 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788839923.178763:0:21290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788839923.178765:0:21290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:0.0:1788839923.178870:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4b73860-6950-4a5d-8d03-52a643e5ff43:3613:1875734060822272:0@lo:250:kworker.0 10000000:01000000:3.0:1788839923.179325:0:21290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788839923.179452:0:21290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573c08 00000020:00000080:3.0:1788839923.179458:0:21290:0:(genops.c:885:class_export_put()) final put ffff8ab646b3a000/d4b73860-6950-4a5d-8d03-52a643e5ff43 00000020:01000000:3.0:1788839923.179466:0:21290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.152@tcp (flags='') 00000020:00000080:3.0:1788839923.179470:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839923.179475:0:21290:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788839923.179479:0:21290:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8ab777fb4d28) has no exports 00000020:00000080:1.0:1788839923.179566:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a07800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788839923.179580:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b3a000/d4b73860-6950-4a5d-8d03-52a643e5ff43 for MGC192.168.203.152@tcp 10000000:01000000:0.0:1788839923.179815:0:17110:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788839923.180318:0:21290:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.152@tcp: client import never connected 00000100:00080000:3.0:1788839923.180322:0:21290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788839923.180324:0:21290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788839923.180327:0:21290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788839923.180329:0:21290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788839923.180491:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839923.180497:0:21290:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.152@tcp (uuid d4b73860-6950-4a5d-8d03-52a643e5ff43) 00000020:01000000:3.0:1788839923.180504:0:21290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788839923.180508:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839923.180513:0:21290:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788839923.180519:0:21290:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8ab744396800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788839923.180525:0:21290:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8ab641944d28) has exports, disconnecting them 00000020:00080000:3.0:1788839923.180528:0:21290:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8ab744396800), last request at 1788839846 00000020:00000080:3.0:1788839923.180532:0:21290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573f49 00000020:00080000:3.0:1788839923.180545:0:21290:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab744396800): rc 0 00000020:00000080:3.0:1788839923.180549:0:21290:0:(genops.c:885:class_export_put()) final put ffff8ab744396800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788839923.180724:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646b3a800 for MGC192.168.203.152@tcp 00000020:00000080:0.0:1788839923.180731:0:37:0:(genops.c:885:class_export_put()) final put ffff8ab646b3c800/d4b73860-6950-4a5d-8d03-52a643e5ff43 00000020:00000080:0.0:1788839923.180734:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b3c800/d4b73860-6950-4a5d-8d03-52a643e5ff43 for MGC192.168.203.152@tcp 00000020:01000000:0.0:1788839923.180742:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.152@tcp (d4b73860-6950-4a5d-8d03-52a643e5ff43) 00000020:00000080:0.0:1788839923.181915:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab744396800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788839923.185859:0:21290:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788839923.185876:0:21290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788839923.185881:0:21290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788839923.185889:0:21290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788839923.186074:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839923.186084:0:21290:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788839923.186090:0:21290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788839923.186094:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839923.186097:0:21290:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788839923.186104:0:21290:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8ab64751c800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788839923.186112:0:21290:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8ab641940000) has exports, disconnecting them 00000020:00080000:0.0:1788839923.186116:0:21290:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8ab64751c800), last request at 1788839846 00000020:00000080:0.0:1788839923.186120:0:21290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573f5e 00000020:00080000:0.0:1788839923.186136:0:21290:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab64751c800): rc 0 00000020:00000080:0.0:1788839923.186141:0:21290:0:(genops.c:885:class_export_put()) final put ffff8ab64751c800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788839923.186515:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6475ac000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788839923.186525:0:37:0:(genops.c:885:class_export_put()) final put ffff8ab647b14000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788839923.186528:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647b14000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788839923.186534:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788839923.186611:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64751c800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788839923.193829:0:21290:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788839923.193838:0:21290:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788839923.193852:0:21290:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788839923.193874:0:21290:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788839923.193907:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647519000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788839923.310764:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788839923.310938:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788839923.311009:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788839923.311152:0:17096:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8ab745c9f200:17096] 0 exiting: rc = 1 00000100:00100000:3.0:1788839923.361064:0:17097:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8ab64653dc00:17097] 1 exiting: rc = 0 00000100:00100000:3.0:1788839923.361170:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361464:0:17098:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8ab751ac9a00:17098] 0 exiting: rc = 1 00000100:00100000:3.0:1788839923.361530:0:17099:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8ab745cb8200:17099] 1 exiting: rc = 0 00000100:00100000:3.0:1788839923.361594:0:17100:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8ab745cb8a00:17100] 2 exiting: rc = 0 00000100:00100000:3.0:1788839923.361666:0:20888:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8ab781f12800:20888] 3 exiting: rc = 0 00000100:00100000:3.0:1788839923.361720:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361728:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361735:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361741:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361747:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361753:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361759:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361764:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361787:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361793:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361798:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361803:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361808:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361813:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361818:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361824:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361829:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361834:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361840:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361845:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361850:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361868:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361872:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361877:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361883:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361888:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361894:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361899:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361905:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361909:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361914:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361919:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361924:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361928:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361933:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361938:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361942:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361947:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361953:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361957:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361963:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361969:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361974:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361979:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361984:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361989:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361994:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.361999:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362004:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362009:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362014:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362018:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362024:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362029:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362034:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362039:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362051:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362056:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362061:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362066:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362072:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362077:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362083:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.362088:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788839923.384181:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839923.384194:0:21290:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788839923.384200:0:21290:0:(genops.c:885:class_export_put()) final put ffff8ab647b17800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788839923.384205:0:21290:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647b17800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788839923.384210:0:21290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788839923.384273:0:21290:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab778bee800 1 00000020:00000080:3.0:1788839923.384280:0:21290:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573f03 00000020:00000080:3.0:1788839923.384286:0:21290:0:(genops.c:885:class_export_put()) final put ffff8ab6475a8800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788839923.384299:0:21290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788839923.384308:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6475a8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788839923.384317:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839923.384322:0:21290:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788839923.384326:0:21290:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8ab77e4f8000) has no exports 00000020:00000080:3.0:1788839923.462933:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839923.464246:0:21290:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788839923.464251:0:21290:0:(genops.c:885:class_export_put()) final put ffff8ab778beb800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788839923.464256:0:21290:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab778beb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788839923.464271:0:21290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788839923.464573:0:21290:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab778be8000 00000020:01000000:3.0:1788839923.464595:0:21290:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788839923.464599:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839923.464603:0:21290:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788839923.464607:0:21290:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8ab7487d0000) has no exports 00000020:00000080:3.0:1788839923.464636:0:21290:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839923.464651:0:21290:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788839923.464654:0:21290:0:(genops.c:885:class_export_put()) final put ffff8ab75867d800/OSS_uuid 00000020:00000080:3.0:1788839923.464656:0:21290:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab75867d800/OSS_uuid for OSS 00000020:01000000:3.0:1788839923.464660:0:21290:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788839923.464694:0:17109:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788839923.464866:0:18621:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8ab744398a00:18621] 1 exiting: rc = 0 00000100:00100000:3.0:1788839923.469453:0:18620:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8ab744399c00:18620] 0 exiting: rc = 1 00000100:00100000:3.0:1788839923.469581:0:19600:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8ab647bd1c00:19600] 4 exiting: rc = 0 00000100:00100000:0.0:1788839923.479259:0:18622:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8ab744398000:18622] 2 exiting: rc = 0 00000100:00100000:0.0:1788839923.479594:0:19203:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8ab64695e800:19203] 3 exiting: rc = 0 00000100:00100000:3.0:1788839923.479836:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479845:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479850:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479854:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479860:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479865:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479870:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479875:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479881:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479886:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479891:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479896:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479901:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479906:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479911:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479917:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479922:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479927:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479932:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479938:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479952:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479966:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479971:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479976:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479982:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479987:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.479992:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480009:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480015:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480029:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480035:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480040:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480045:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480051:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480055:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480060:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480065:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480070:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480075:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480081:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480087:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480091:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480096:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480101:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480106:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480111:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480116:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480121:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480126:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480131:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480136:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480141:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480146:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480152:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480322:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480333:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480339:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480344:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480349:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480354:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480359:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480364:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480377:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.480386:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.481672:0:18624:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8ab744398200:18624] 0 exiting: rc = 1 00000100:00100000:0.0:1788839923.481966:0:18625:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8ab74f11e800:18625] 1 exiting: rc = 0 00000100:00100000:3.0:1788839923.482098:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482106:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482112:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482118:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482123:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482129:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482134:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482140:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482146:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482151:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482222:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482231:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482236:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482241:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482246:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482251:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482256:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482261:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482266:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482271:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482276:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482281:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482285:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482290:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482296:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482301:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482306:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482311:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482316:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482347:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482354:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482359:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482373:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482377:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482381:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482386:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482390:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482395:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482400:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482404:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482409:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482414:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482419:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482424:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482429:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482435:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482439:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482443:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482448:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482454:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482459:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482464:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482470:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482476:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482481:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482486:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482492:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482528:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482535:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482545:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482551:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482557:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482562:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.482579:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.484553:0:18626:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8ab776851800:18626] 0 exiting: rc = 1 00000100:00100000:0.0:1788839923.484831:0:18627:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8ab776850a00:18627] 1 exiting: rc = 0 00000100:00100000:3.0:1788839923.486868:0:18628:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8ab776850c00:18628] 2 exiting: rc = 0 00000100:00100000:3.0:1788839923.486963:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.486984:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.486990:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.486998:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487004:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487011:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487269:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487286:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487303:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487310:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487317:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487321:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487327:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487333:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487340:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487356:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487363:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487368:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487374:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487379:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487386:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487393:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487400:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487407:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487413:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487418:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487423:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487428:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487433:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487438:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487443:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487449:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487465:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487471:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487476:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487482:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487494:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487500:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487506:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487511:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487517:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487523:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487528:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487533:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487538:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487544:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487550:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487556:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487562:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487568:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487573:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487578:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487583:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487589:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487595:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487600:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487618:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487625:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487630:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487636:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487642:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487648:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487654:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.487660:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.494710:0:18630:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8ab6478d7c00:18630] 1 exiting: rc = 0 00000100:00100000:0.0:1788839923.494787:0:18629:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8ab647a29600:18629] 0 exiting: rc = 1 00000100:00100000:3.0:1788839923.495270:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495277:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495283:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495287:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495293:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495298:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495315:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495319:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495324:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495328:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495332:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495337:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495341:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495346:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495350:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495355:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495360:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495365:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495370:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495375:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495379:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495383:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495389:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495394:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495399:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495405:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495410:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495415:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495419:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495424:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495429:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495433:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495438:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495443:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495449:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495454:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495459:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495464:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495470:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495475:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495480:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495493:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495498:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495502:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495506:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495511:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495516:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495520:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495525:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495529:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495534:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495539:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495544:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495549:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495554:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495558:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495563:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495568:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495572:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495577:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495582:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495587:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495593:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839923.495598:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.501363:0:18631:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8ab647a29400:18631] 0 exiting: rc = 1 00000100:00100000:3.0:1788839923.509376:0:18632:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8ab6478d7600:18632] 1 exiting: rc = 0 00000100:00100000:0.0:1788839923.509601:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509620:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509628:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509634:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509640:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509647:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509652:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509658:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509663:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509669:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509704:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509711:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509717:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509725:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509731:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509737:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509743:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509750:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509755:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509762:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509767:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509801:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509822:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509829:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509834:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509841:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509849:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509856:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509862:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509869:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509875:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509881:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509888:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509894:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509916:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509924:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509931:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509939:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509944:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509950:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509966:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509973:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509979:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509985:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.509991:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510004:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510032:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510039:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510045:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510053:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510058:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510064:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510069:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510076:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510082:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510088:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510094:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510100:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510120:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510127:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510132:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510139:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510145:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839923.510265:0:21290:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788839923.547671:0:21290:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788839946.944074:0:22057:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788839956.592450:0:22656:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788839956.592457:0:22656:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788839956.592458:0:22656:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788839956.592569:0:22656:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab781e72000 00000020:01000004:3.0:1788839956.592586:0:22656:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788839956.592594:0:22656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788839956.592608:0:22656:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ab646690000) 00000020:00000080:3.0:1788839956.592622:0:22656:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788839956.657381:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788839956.657686:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788839956.660686:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788839956.665078:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788839956.665388:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788839956.665631:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788839956.665887:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788839956.666383:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788839956.666589:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788839956.666868:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788839956.667128:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788839956.668648:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788839956.668992:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788839956.669273:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788839956.670320:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788839956.671115:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788839956.671444:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1788839956.671758:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788839956.672128:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788839956.672453:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788839956.672689:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788839956.672918:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788839956.673171:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788839956.673430:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788839956.673627:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788839956.673841:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788839956.674062:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788839956.674441:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788839956.677602:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788839956.678135:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788839956.678449:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788839956.678793:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788839956.679080:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788839956.679377:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788839956.679696:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788839956.680041:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788839956.680314:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788839956.680573:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788839956.680876:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788839956.681419:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788839956.681634:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788839956.682043:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788839956.682307:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788839956.682568:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788839956.682746:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788839956.682988:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788839956.683291:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788839956.684875:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788839956.685341:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788839956.685591:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788839956.686014:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788839956.686265:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788839956.686540:0:22656:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1788839956.687578:0:22656:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788839956.687896:0:22656:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788839956.687904:0:22656:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788839956.687915:0:22656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a2657450e 00000020:01000004:2.0:1788839956.687921:0:22656:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788839956.687925:0:22656:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788839956.687930:0:22656:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab781e72000 from MGS 00000020:01000004:2.0:1788839956.687942:0:22656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788839956.687959:0:22656:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ab641943370) 00000020:00000080:2.0:1788839956.687969:0:22656:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788839956.688026:0:22656:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab781e72000 from MGS, refs=2 00080000:01000000:2.0:1788839956.688038:0:22656:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788839956.688043:0:22656:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a2657451c 00000100:00100000:2.0:1788839956.688132:0:22656:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788839956.688299:0:22656:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788839956.688306:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788839956.688747:0:22656:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788839956.688753:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788839956.689980:0:22656:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839956.690180:0:22656:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788839956.690440:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788839956.691172:0:22656:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788839956.691181:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788839956.691634:0:22656:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788839956.691640:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788839956.692754:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839956.692758:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839956.692760:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839956.693245:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839956.693248:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839956.693250:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839956.693686:0:22656:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:3.0:1788839956.698056:0:22656:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788839956.698735:0:22668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788839956.698804:0:22656:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788839956.698834:0:22656:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00010000:00010000:2.0:1788839956.699169:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788839956.699544:0:22656:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788839956.699889:0:22656:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788839956.700077:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788839956.700085:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788839956.700714:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788839956.700722:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788839956.704746:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788839956.704757:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788839956.706076:0:22673:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788839956.706235:0:22656:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788839956.706254:0:22656:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:2.0:1788839956.706256:0:22656:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788839956.706285:0:22656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:2.0:1788839956.706297:0:22656:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (ffff8ab6419419b8) 00000020:00000080:2.0:1788839956.706311:0:22656:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788839956.706386:0:22656:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab641750800@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788839956.706538:0:22656:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:2.0:1788839956.706544:0:22656:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788839956.707540:0:22674:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788839956.708717:0:22656:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid 4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e) 00000020:00000080:3.0:1788839956.708741:0:22656:0:(genops.c:1385:class_connect()) connect: client 4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e, cookie 0xad5b343a2657452a 00000100:00080000:3.0:1788839956.708753:0:22656:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839956.708760:0:22656:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff8ab641750800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839956.708830:0:22656:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4e680 x1875734060822400/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788839956.708860:0:22656:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e->MGS 00000020:01000004:1.0:1788839956.708883:0:22656:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788839956.708888:0:22656:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788839956.708902:0:22656:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8ab77e4f99b8) 00000020:00000080:1.0:1788839956.708920:0:22656:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788839956.712258:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3613:1875734060822400:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788839956.712335:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839956.712378:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060822400 00000100:00100000:3.0:1788839956.712386:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060822400 00000100:00100000:3.0:1788839956.712417:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839956.712423:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3613:x1875734060822400:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788839956.712449:0:22669:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e@0@lo t0 exp 0000000000000000 cur 611 last 0 00000020:00000080:3.0:1788839956.712479:0:22669:0:(genops.c:1385:class_connect()) connect: client 4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e, cookie 0xad5b343a26574538 00000100:00080000:3.0:1788839956.715240:0:22669:0:(import.c:65:import_set_state_nolock()) ffff8ab744396800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839956.715748:0:22656:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788839956.715757:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+5:3613:x1875734060822400:12345-0@lo:250:mount.lustre.0 Request processed in 3330us (3419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839956.715767:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839956.715996:0:3613:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788839956.716005:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:3.0:1788839956.716013:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788839956.716018:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788839956.716022:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab641750800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788839956.716024:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788839956.716034:0:3613:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788839956.716039:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3613:1875734060822400:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788839956.717332:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788839956.717340:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788839956.720970:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788839956.720982:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788839956.722214:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788839956.722224:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788839956.723497:0:22656:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839956.724498:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788839956.724504:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788839956.726161:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788839956.726171:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788839956.773092:0:22656:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839956.777254:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788839956.777263:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788839956.780707:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788839956.780720:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788839956.781697:0:22656:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839956.782225:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788839956.782232:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788839956.784077:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788839956.784089:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788839956.786198:0:22656:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839956.786396:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788839956.786402:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788839956.789837:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788839956.789851:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788839956.790762:0:22656:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839956.791211:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788839956.791217:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788839956.794048:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788839956.794068:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788839956.810240:0:22656:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788839956.810469:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788839956.810477:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788839956.812318:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788839956.812332:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788839956.813360:0:22656:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788839956.813370:0:22656:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788839956.814610:0:22656:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788839956.814638:0:22656:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788839956.814644:0:22656:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788839956.814741:0:22656:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788839956.815112:0:22656:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788839956.815116:0:22656:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788839956.815118:0:22656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788839956.815119:0:22656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839956.815120:0:22656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839956.815121:0:22656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839956.815123:0:22656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839956.815124:0:22656:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839956.815126:0:22656:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788839956.815128:0:22656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839956.815129:0:22656:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839956.815137:0:22656:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788839956.815139:0:22656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788839956.815140:0:22656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788839956.815141:0:22656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839956.815142:0:22656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839956.815143:0:22656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839956.815144:0:22656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839956.815145:0:22656:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839956.815145:0:22656:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788839956.815146:0:22656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839956.815147:0:22656:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788839956.815261:0:22656:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788839956.815281:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060822528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788839956.815357:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839956.815436:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b4a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839956.815482:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060822528 00000100:00100000:3.0:1788839956.815489:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060822528 00000100:00100000:3.0:1788839956.815569:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839956.815579:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+5:22656:x1875734060822528:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788839956.815624:0:22672:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788839956.815627:0:22672:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788839956.815630:0:22672:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788839956.816123:0:22692:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788839956.820452:0:22672:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1788839956.822661:0:22693:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788839956.822669:0:22693:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788839956.822672:0:22693:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788839956.822675:0:22693:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788839956.823228:0:22693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788839956.823435:0:22672:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788839956.823446:0:22672:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788839956.827489:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+5:22656:x1875734060822528:12345-0@lo:253:mount.lustre.0 Request processed in 11904us (12125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839956.827503:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839956.827577:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060822528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788839956.827592:0:22656:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788839956.827596:0:22656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788839956.827598:0:22656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788839956.827599:0:22656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839956.827600:0:22656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839956.827601:0:22656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839956.827602:0:22656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839956.827603:0:22656:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839956.827605:0:22656:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788839956.827607:0:22656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839956.827608:0:22656:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788839956.827643:0:22656:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab781e72000 from lustre-MDT0000 10000000:01000000:2.0:1788839956.827679:0:22656:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788839956.827681:0:22656:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788839956.827685:0:22656:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ab6419419b8 10000000:01000000:2.0:1788839956.827689:0:22656:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788839956.827697:0:22656:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab6419419b8 from 1 10000000:01000000:2.0:1788839956.827700:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788839956.827742:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.827754:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.828084:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839956.828105:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060822656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788839956.828144:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839956.828229:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647abf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788839956.828466:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060822656 00000100:00100000:3.0:1788839956.828474:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060822656 00000100:00100000:0.0:1788839956.828562:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839956.828573:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+5:22656:x1875734060822656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839956.828594:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839956.828611:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab781e68200/0xad5b343a26574546 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657453f expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839956.828635:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab781e68200/0xad5b343a26574546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657453f expref: 6 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839956.828645:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab781e68200/0xad5b343a26574546 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657453f expref: 6 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839956.828652:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e68200, rc 0) 00000100:00100000:0.0:1788839956.828689:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+6:22656:x1875734060822656:12345-0@lo:101:mount.lustre.0 Request processed in 120us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839956.828694:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839956.828754:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060822656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839956.828767:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.828798:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839956.829036:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060822784:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839956.829065:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839956.829095:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647abf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788839956.829140:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060822784 00000100:00100000:3.0:1788839956.829144:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060822784 00000100:00100000:3.0:1788839956.829169:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839956.829176:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+6:22656:x1875734060822784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839956.829294:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+6:22656:x1875734060822784:12345-0@lo:501:mount.lustre.0 Request processed in 117us (227us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788839956.829301:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839956.829352:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060822784:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788839956.829381:0:22656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788839956.829427:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.829438:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839956.829447:0:22656:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab781e72000 10000000:01000000:2.0:1788839956.829456:0:22656:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788839956.829465:0:22656:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ab781e72000 10000000:01000000:2.0:1788839956.829468:0:22656:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788839956.829471:0:22656:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ab781e72000 from 1 10000000:01000000:2.0:1788839956.829474:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788839956.829493:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6400/0xad5b343a2657454d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.829500:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de6400/0xad5b343a2657454d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.829508:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de6400/0xad5b343a2657454d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839956.829520:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060822912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788839956.829546:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839956.829596:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060822912 00000100:00100000:0.0:1788839956.829600:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060822912 00000100:00100000:2.0:1788839956.829602:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647abf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788839956.829632:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839956.829639:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+6:22656:x1875734060822912:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839956.829646:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839956.829668:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab781e69c00/0xad5b343a26574554 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657454d expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839956.829685:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab781e69c00/0xad5b343a26574554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657454d expref: 7 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839956.829694:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab781e69c00/0xad5b343a26574554 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657454d expref: 7 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839956.829701:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e69c00, rc 0) 00000100:00100000:0.0:1788839956.829745:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+7:22656:x1875734060822912:12345-0@lo:101:mount.lustre.0 Request processed in 106us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839956.829751:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839956.830388:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060822912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839956.830404:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de6400/0xad5b343a2657454d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574554 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.830424:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6400/0xad5b343a2657454d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574554 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839956.830439:0:22656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788839956.830493:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6400/0xad5b343a2657454d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574554 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.830499:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de6400/0xad5b343a2657454d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574554 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839956.830514:0:22656:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788839956.830517:0:22656:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788839956.830520:0:22656:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ab781e72000 10000000:01000000:2.0:1788839956.830522:0:22656:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788839956.830524:0:22656:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788839956.830526:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788839956.830542:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6000/0xad5b343a2657455b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.830546:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de6000/0xad5b343a2657455b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.830552:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de6000/0xad5b343a2657455b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839956.830562:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060823040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788839956.830586:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839956.830603:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647abf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788839956.830975:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060823040 00000100:00100000:3.0:1788839956.830982:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060823040 00000100:00100000:3.0:1788839956.831053:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839956.831063:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+7:22656:x1875734060823040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839956.831074:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839956.831087:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553200/0xad5b343a26574562 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657455b expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839956.831104:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553200/0xad5b343a26574562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657455b expref: 8 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839956.831113:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553200/0xad5b343a26574562 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657455b expref: 8 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839956.831119:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553200, rc 0) 00000100:00100000:3.0:1788839956.831161:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+8:22656:x1875734060823040:12345-0@lo:101:mount.lustre.0 Request processed in 100us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839956.831167:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788839956.831239:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060823040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839956.831252:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de6000/0xad5b343a2657455b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574562 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.831260:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6000/0xad5b343a2657455b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574562 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839956.831312:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060823168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839956.831338:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839956.831380:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647abf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788839956.831429:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060823168 00000100:00100000:0.0:1788839956.831433:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060823168 00000100:00100000:0.0:1788839956.831460:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839956.831466:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+8:22656:x1875734060823168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839956.831587:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+9:22656:x1875734060823168:12345-0@lo:501:mount.lustre.0 Request processed in 121us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839956.831594:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839956.831661:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060823168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839956.831688:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060823296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839956.831726:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839956.831747:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647abf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788839956.832406:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060823296 00000100:00100000:3.0:1788839956.832412:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060823296 00000100:00100000:0.0:1788839956.832592:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839956.832601:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+9:22656:x1875734060823296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839956.834985:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+9:22656:x1875734060823296:12345-0@lo:503:mount.lustre.0 Request processed in 2377us (3250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839956.834998:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839956.835301:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060823296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839956.836178:0:22694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22694:1875734060823424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839956.836233:0:22694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839956.836271:0:22694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647abf480 going to sleep for 11 seconds 00000100:00100000:3.0:1788839956.836323:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060823424 00000100:00100000:3.0:1788839956.836329:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060823424 00000100:00100000:3.0:1788839956.836534:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839956.836544:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+9:22694:x1875734060823424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839956.837244:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+9:22694:x1875734060823424:12345-0@lo:502:llog_process_th.0 Request processed in 699us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839956.837253:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788839956.837340:0:22694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22694:1875734060823424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839956.837379:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839956.837389:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839956.837392:0:22694:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788839956.837408:0:22694:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788839956.837411:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839956.837425:0:22694:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ab641940000) 00000020:00000080:2.0:1788839956.837439:0:22694:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788839956.837444:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788839956.837518:0:22694:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788839956.837525:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26574570 00000020:00000080:2.0:1788839956.837724:0:22694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788839956.837729:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839956.837733:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839956.837735:0:22694:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788839956.837737:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839956.837740:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839956.837742:0:22694:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788839956.837745:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839956.837752:0:22694:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ab641944d28) 00000020:00000080:2.0:1788839956.837761:0:22694:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788839956.837791:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788839956.837793:0:22694:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788839956.837796:0:22694:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788839956.837802:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788839956.838156:0:22694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab781e72000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788839956.838171:0:22694:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ab7487d0000) 00000020:00000080:2.0:1788839956.838179:0:22694:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788839956.838248:0:22694:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788839956.838255:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26574585 00000020:00000080:2.0:1788839956.838345:0:22694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788839956.838352:0:22694:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788839956.838367:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xad5b343a2657458c 00080000:01000000:2.0:1788839956.838372:0:22694:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788839956.838376:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26574593 00010000:00010000:1.0:1788839956.926348:0:22694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788839956.927672:0:22694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:1.0:1788839956.928161:0:22694:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788839956.929802:0:22694:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ab77e4fcd28) 00000020:00000080:1.0:1788839956.929819:0:22694:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788839956.929908:0:22694:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788839956.929914:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a265745a1 00000020:00000080:2.0:1788839956.930812:0:22694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788839956.935837:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xad5b343a265745a8 00000020:00000080:3.0:1788839956.937640:0:22694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788839956.937653:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839956.937660:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.937662:0:22694:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788839956.937665:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788839956.937668:0:22694:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788839956.937670:0:22694:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839956.937671:0:22694:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839956.937672:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788839956.937674:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.937676:0:22694:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788839956.937678:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839956.937683:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.937684:0:22694:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788839956.937689:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788839956.937733:0:22694:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788839956.937750:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839956.937753:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.937754:0:22694:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788839956.937756:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839956.937759:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.937761:0:22694:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788839956.937763:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788839956.937788:0:22694:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:00000080:3.0:1788839956.937820:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839956.937835:0:22694:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ab646693370) 00000020:00000080:3.0:1788839956.937850:0:22694:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788839956.937854:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788839956.937942:0:22694:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788839956.937956:0:22694:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788839956.937963:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a265745b6 00010000:00080000:3.0:1788839956.937993:0:22694:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab78193a000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788839956.942071:0:22694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788839956.945207:0:22694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788839956.945221:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788839956.945259:0:22694:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788839956.945276:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a265745bd 00000100:00080000:3.0:1788839956.945287:0:22694:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839956.945292:0:22694:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ab78193a000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839956.945327:0:22694:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7443da680 x1875734060823552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839956.945357:0:22694:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788839956.945413:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839956.945416:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.945418:0:22694:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788839956.945421:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788839956.945424:0:22694:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1788839956.945426:0:22694:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839956.945427:0:22694:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839956.945428:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788839956.945430:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.945431:0:22694:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788839956.945434:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788839956.945438:0:22694:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788839956.945441:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.945442:0:22694:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788839956.945445:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788839956.945448:0:22694:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788839956.945472:0:22694:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788839956.945474:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839956.945608:0:22694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ab6466919b8) 00000020:00000080:3.0:1788839956.945621:0:22694:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788839956.945627:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788839956.945668:0:22694:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788839956.945672:0:22694:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788839956.945676:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a265745cb 00010000:00080000:3.0:1788839956.945697:0:22694:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab78193b800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788839956.945850:0:22694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788839956.946360:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060823552:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788839956.946438:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839956.946802:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060823552 00000100:00100000:3.0:1788839956.946810:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060823552 00000100:00100000:3.0:1788839956.946841:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839956.946848:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875734060823552:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788839956.946863:0:22681:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1788839956.952120:0:22694:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788839956.953386:0:22694:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788839956.956101:0:22694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839956.956635:0:22694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1788839956.964265:0:22694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000100:00100000:3.0:1788839956.964381:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875734060823552:12345-0@lo:38:llog_process_th.0 Request processed in 17528us (17939us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788839956.964394:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788839956.964510:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839956.964516:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788839956.964520:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060823552:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788839956.965331:0:22700:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788839956.965337:0:22700:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788839956.967034:0:22694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788839956.967047:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788839956.967084:0:22694:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788839956.967102:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a265745d2 00000100:00080000:3.0:1788839956.967110:0:22694:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839956.967114:0:22694:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab78193b800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839956.967144:0:22694:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7443d9180 x1875734060823680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839956.967170:0:22694:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788839956.967241:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839956.967245:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.967247:0:22694:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788839956.967250:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788839956.967259:0:22694:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788839956.967260:0:22694:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839956.967262:0:22694:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839956.967264:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788839956.967267:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.967268:0:22694:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788839956.967271:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788839956.967275:0:22694:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788839956.967278:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.967280:0:22694:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788839956.967283:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788839956.967287:0:22694:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788839956.967309:0:22694:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788839956.967312:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839956.967323:0:22694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ab646694d28) 00000020:00000080:3.0:1788839956.967333:0:22694:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788839956.967337:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788839956.967378:0:22694:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788839956.967382:0:22694:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788839956.967385:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a265745e0 00010000:00080000:3.0:1788839956.967405:0:22694:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab78193d800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788839956.967533:0:22694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788839956.967590:0:22694:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788839956.967604:0:22694:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1788839956.967796:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060823680:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788839956.967835:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060823680 offset 0 length 520: 4 00000040:00080000:3.0:1788839956.972174:0:22694:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839956.972473:0:22694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788839956.972746:0:22694:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1788839956.973355:0:22702:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788839956.973360:0:22702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788839956.974274:0:22694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788839956.974288:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788839956.974323:0:22694:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788839956.974342:0:22694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a265745e7 00000100:00080000:3.0:1788839956.974352:0:22694:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839956.974366:0:22694:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab78193d800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839956.974402:0:22694:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7443daa00 x1875734060823808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839956.974430:0:22694:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788839956.974488:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839956.974492:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.974493:0:22694:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788839956.974496:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839956.974510:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.974512:0:22694:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788839956.974515:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788839956.974517:0:22694:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788839956.974520:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839956.974522:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.974523:0:22694:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788839956.974525:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839956.974528:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.974529:0:22694:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788839956.974532:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788839956.974567:0:22694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22694:1875734060823936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839956.974644:0:22694:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839956.974683:0:22694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760dba480 going to sleep for 11 seconds 00000100:00100000:0.0:1788839956.974902:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060823936 00000100:00100000:0.0:1788839956.974909:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060823936 00000100:00100000:0.0:1788839956.974984:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839956.974999:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+9:22694:x1875734060823936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839956.975109:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+9:22694:x1875734060823936:12345-0@lo:502:llog_process_th.0 Request processed in 111us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839956.975117:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839956.975245:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060823808:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788839956.975270:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060823808 offset 0 length 520: 4 00000100:00100000:3.0:1788839956.975628:0:22694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22694:1875734060823936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788839956.975657:0:22694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839956.975663:0:22694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.975665:0:22694:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788839956.975669:0:22694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788839956.975832:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788839956.975851:0:22656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788839956.975867:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6000/0xad5b343a2657455b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574562 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.975875:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de6000/0xad5b343a2657455b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574562 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839956.975889:0:22656:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab781e72000 from 1 10000000:01000000:2.0:1788839956.975891:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788839956.975913:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.975918:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.975925:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839956.975936:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788839956.975977:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839956.975996:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7450503c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839956.976217:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060824064 00000100:00100000:3.0:1788839956.976223:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060824064 00000100:00100000:3.0:1788839956.976265:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839956.976272:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+9:22656:x1875734060824064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839956.976290:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839956.976302:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553000/0xad5b343a265745f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265745ee expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839956.976514:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553000/0xad5b343a265745f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265745ee expref: 10 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839956.976526:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553000/0xad5b343a265745f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265745ee expref: 10 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839956.976535:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553000, rc 0) 00000100:00100000:3.0:1788839956.976651:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+10:22656:x1875734060824064:12345-0@lo:101:mount.lustre.0 Request processed in 378us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839956.976658:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788839956.976803:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839956.976818:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.976827:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839956.977630:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824192:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788839956.977681:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839956.977994:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060824192 00000100:00100000:3.0:1788839956.978001:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060824192 00000100:00100000:3.0:1788839956.978047:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839956.978056:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+10:22656:x1875734060824192:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788839956.978074:0:22669:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788839956.978080:0:22669:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788839956.978143:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+10:22656:x1875734060824192:12345-0@lo:256:mount.lustre.0 Request processed in 88us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839956.978151:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839956.978260:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7450503c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839956.978279:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824192:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788839956.979522:0:22656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788839956.979548:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839956.979628:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839956.979640:0:22656:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab781e72000 from 1 10000000:01000000:0.0:1788839956.979644:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839956.979686:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839956.979694:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839956.979703:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839956.979733:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824320:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839956.980009:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839956.980046:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7766dde40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839956.980119:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060824320 00000100:00100000:3.0:1788839956.980127:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060824320 00000100:00100000:3.0:1788839956.980181:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839956.980190:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+10:22656:x1875734060824320:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839956.980205:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839956.980226:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574603 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265745fc expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839956.980250:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265745fc expref: 11 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839956.980261:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265745fc expref: 11 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839956.980268:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553c00, rc 0) 00000100:00100000:3.0:1788839956.980363:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:22656:x1875734060824320:12345-0@lo:101:mount.lustre.0 Request processed in 173us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839956.980370:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839956.980474:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839956.980489:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839956.980498:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839956.980633:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839956.980660:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839956.980735:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839956.980849:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060824448 00000100:00100000:0.0:1788839956.980853:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060824448 00000100:00100000:0.0:1788839956.980912:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788839956.980919:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:22656:x1875734060824448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839956.981061:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:22656:x1875734060824448:12345-0@lo:501:mount.lustre.0 Request processed in 142us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839956.981068:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788839956.981128:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839956.981170:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839956.981222:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839956.981635:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839956.981806:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060824576 00000100:00100000:3.0:1788839956.981811:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060824576 00000100:00100000:3.0:1788839956.981835:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839956.981842:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:22656:x1875734060824576:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839956.982084:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:22656:x1875734060824576:12345-0@lo:503:mount.lustre.0 Request processed in 241us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839956.982091:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788839956.982478:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839956.984037:0:22704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22704:1875734060824704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839956.984114:0:22704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839956.984188:0:22704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839956.985692:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060824704 00000100:00100000:3.0:1788839956.985703:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060824704 00000100:00100000:2.0:1788839956.986098:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839956.986110:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:22704:x1875734060824704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839956.986603:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:22704:x1875734060824704:12345-0@lo:502:llog_process_th.0 Request processed in 494us (2486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839956.986617:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839956.986745:0:22704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22704:1875734060824704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839956.986797:0:22704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839956.986806:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839956.986808:0:22704:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788839956.986816:0:22704:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab781e72000 00000020:00000080:1.0:1788839956.986819:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839956.986826:0:22704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839956.986829:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839956.986830:0:22704:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788839956.986832:0:22704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839956.986834:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839956.986835:0:22704:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788839956.986839:0:22704:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab781e72000 00000020:00000080:1.0:1788839956.986840:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839956.986894:0:22704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839956.986898:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839956.986899:0:22704:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788839956.986902:0:22704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839956.986904:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839956.986906:0:22704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839956.986916:0:22704:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab781e72000 00000020:00000080:1.0:1788839956.986918:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839956.986936:0:22704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839956.986939:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839956.986941:0:22704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839956.986943:0:22704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839956.986953:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839956.986955:0:22704:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788839956.986958:0:22704:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab781e72000 00000020:00000080:1.0:1788839956.986960:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788839956.987003:0:22704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22704:1875734060824832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839956.987057:0:22704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839956.987098:0:22704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839956.987226:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060824832 00000100:00100000:0.0:1788839956.987232:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060824832 00000100:00100000:0.0:1788839956.987267:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839956.987275:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:22704:x1875734060824832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839956.987373:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:22704:x1875734060824832:12345-0@lo:502:llog_process_th.0 Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839956.987380:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839956.990126:0:22704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22704:1875734060824832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788839956.990168:0:22704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839956.990176:0:22704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839956.990178:0:22704:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788839956.990183:0:22704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788839956.990418:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788839956.990438:0:22656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839956.990461:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839956.990473:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839956.990527:0:22656:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788839956.990530:0:22656:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab781e72000 10000000:01000000:1.0:1788839956.990533:0:22656:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab781e72000 10000000:01000000:1.0:1788839956.990537:0:22656:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839956.990542:0:22656:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab781e72000 from 1 10000000:01000000:1.0:1788839956.990545:0:22656:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788839956.990590:0:22656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464e00/0xad5b343a2657460a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839956.990599:0:22656:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab741464e00/0xad5b343a2657460a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839956.990616:0:22656:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab741464e00/0xad5b343a2657460a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839956.990635:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788839956.990695:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839956.990738:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839956.992194:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060824960 00000100:00100000:2.0:1788839956.992206:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060824960 00000100:00100000:2.0:1788839956.992320:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788839956.992330:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:22656:x1875734060824960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839956.992347:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839956.992365:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de6800/0xad5b343a26574611 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657460a expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.992392:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6800/0xad5b343a26574611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657460a expref: 12 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.992403:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de6800/0xad5b343a26574611 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657460a expref: 12 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839956.992412:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6800, rc 0) 00000100:00100000:2.0:1788839956.992476:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22656:x1875734060824960:12345-0@lo:101:mount.lustre.0 Request processed in 148us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839956.992483:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788839956.995236:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060824960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839956.995264:0:22656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab741464e00/0xad5b343a2657460a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574611 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839956.995276:0:22656:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab741464e00/0xad5b343a2657460a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574611 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839956.995370:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060825088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839956.995426:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839956.995465:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839956.995489:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060825088 00000100:00100000:1.0:1788839956.995495:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060825088 00000100:00100000:1.0:1788839956.995537:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788839956.995546:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22656:x1875734060825088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839956.995878:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22656:x1875734060825088:12345-0@lo:501:mount.lustre.0 Request processed in 332us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839956.995886:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788839956.995925:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060825088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839956.995976:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060825216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839956.996023:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839956.996036:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839956.996504:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060825216 00000100:00100000:2.0:1788839956.996510:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060825216 00000100:00100000:2.0:1788839956.996537:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788839956.996545:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22656:x1875734060825216:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839956.996644:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22656:x1875734060825216:12345-0@lo:503:mount.lustre.0 Request processed in 100us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839956.996651:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788839956.997731:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060825216:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839957.000786:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22709:1875734060825344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839957.001026:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839957.001083:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839957.001165:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060825344 00000100:00100000:2.0:1788839957.001180:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060825344 00000100:00100000:2.0:1788839957.001234:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788839957.001243:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22709:x1875734060825344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839957.001640:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22709:x1875734060825344:12345-0@lo:502:llog_process_th.0 Request processed in 395us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839957.001649:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788839957.001670:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22709:1875734060825344:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788839957.001734:0:22709:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788839957.001750:0:22709:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ab77e4f8000) 00000020:00000080:1.0:1788839957.001786:0:22709:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788839957.002029:0:22709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab781e72000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788839957.002034:0:22709:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab781e72000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788839957.002037:0:22709:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab781e72000 4 00010000:00080000:1.0:1788839957.002066:0:22709:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab64751c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788839957.004269:0:22709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788839957.004464:0:22709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788839957.004503:0:22709:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788839957.004517:0:22709:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xad5b343a2657461f 00000100:00080000:1.0:1788839957.004527:0:22709:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839957.004533:0:22709:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ab64751c800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839957.005660:0:22709:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4f800 x1875734060825472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788839957.005697:0:22709:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788839957.005724:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060825472:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788839957.005819:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839957.008549:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060825472 00000100:00100000:2.0:1788839957.008562:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060825472 00000100:00100000:2.0:1788839957.008606:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839957.008615:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060825472:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788839957.008705:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060825472:12345-0@lo:38:llog_process_th.0 Request processed in 90us (2886us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788839957.008711:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839957.010064:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788839957.010075:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab64751c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839957.010081:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788839957.010085:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060825472:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788839957.011112:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22709:1875734060825600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839957.011186:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839957.011234:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060825600 00000100:00100000:1.0:1788839957.011240:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060825600 00000100:00100000:1.0:1788839957.011280:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788839957.011289:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22709:x1875734060825600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839957.011409:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22709:x1875734060825600:12345-0@lo:502:llog_process_th.0 Request processed in 121us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839957.011416:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788839957.011467:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839957.011484:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22709:1875734060825600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839957.011522:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22709:1875734060825728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839957.011551:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839957.011573:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060825728 00000100:00100000:1.0:1788839957.011577:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060825728 00000100:00100000:1.0:1788839957.011598:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788839957.011603:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22709:x1875734060825728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839957.011661:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22709:x1875734060825728:12345-0@lo:502:llog_process_th.0 Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839957.011667:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788839957.011692:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839957.011703:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22709:1875734060825728:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788839957.011720:0:22709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788839957.013387:0:22656:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788839957.013424:0:22656:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839957.013445:0:22656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464e00/0xad5b343a2657460a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574611 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839957.013458:0:22656:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab741464e00/0xad5b343a2657460a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574611 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788839957.013510:0:22656:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788839957.013512:0:22656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788839957.013513:0:22656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839957.013514:0:22656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839957.013516:0:22656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839957.013517:0:22656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839957.013519:0:22656:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839957.013520:0:22656:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788839957.013522:0:22656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839957.013523:0:22656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839957.013532:0:22656:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788839957.013534:0:22656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788839957.013536:0:22656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788839957.013537:0:22656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839957.013538:0:22656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839957.013539:0:22656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839957.013540:0:22656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839957.013541:0:22656:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839957.013542:0:22656:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788839957.013543:0:22656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839957.013543:0:22656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839957.013570:0:22656:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788839957.013589:0:22656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060825856:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788839957.013646:0:22656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839957.013678:0:22656:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab758752600 going to sleep for 11 seconds 00000100:00100000:1.0:1788839957.016357:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060825856 00000100:00100000:1.0:1788839957.016369:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060825856 00000100:00100000:1.0:1788839957.016426:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788839957.016436:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22656:x1875734060825856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788839957.016469:0:22669:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788839957.016487:0:22669:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788839957.018922:0:22669:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788839957.018941:0:22669:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788839957.020237:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22656:x1875734060825856:12345-0@lo:253:mount.lustre.0 Request processed in 3795us (6583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839957.020249:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788839957.020507:0:22656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22656:1875734060825856:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788839957.020521:0:22656:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788839957.020525:0:22656:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788839957.020527:0:22656:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788839957.020528:0:22656:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839957.020529:0:22656:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839957.020530:0:22656:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839957.020531:0:22656:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839957.020532:0:22656:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839957.020534:0:22656:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788839957.020535:0:22656:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839957.020536:0:22656:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788839957.020552:0:22656:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788839957.021452:0:22692:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788839957.021459:0:22692:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788839957.021479:0:22692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.021509:0:22692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e553000/0xad5b343a265745f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265745ee expref: 11 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.021517:0:22692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.021553:0:22692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e553000/0xad5b343a265745f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265745ee expref: 11 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.021568:0:22692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab75e553000/0xad5b343a265745f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265745ee expref: 11 pid: 22672 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839957.021581:0:22692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060825984:0@lo:104: 00000100:00100000:0.0:1788839957.021627:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839957.022051:0:22692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77668a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839957.025700:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060825984 00000100:00100000:1.0:1788839957.025717:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060825984 00000100:00100000:1.0:1788839957.025792:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839957.025803:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:22692:x1875734060825984:12345-0@lo:104: 00010000:00010000:1.0:1788839957.025895:0:22660:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.025991:0:22660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839957.025998:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:22692:x1875734060825984:12345-0@lo:104: Request processed in 198us (4371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839957.026005:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839957.026195:0:22692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060825984:0@lo:104: 00010000:00010000:0.0:1788839957.026285:0:22692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.026610:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839957.026618:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.026627:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839957.026632:0:22666:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.026640:0:22666:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839957.026660:0:22666:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839957.026666:0:22666:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839957.026711:0:22666:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.026718:0:22666:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839957.026742:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.026749:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265745ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265745f5 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.026763:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839957.026765:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839957.026785:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839957.026820:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060826112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839957.026862:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839957.026940:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060826112 00000100:00100000:1.0:1788839957.026954:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060826112 00010000:00010000:1.0:1788839957.026977:0:22662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e553000/0xad5b343a265745f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265745ee expref: 12 pid: 22672 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839957.027001:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839957.027008:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:3616:x1875734060826112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839957.027020:0:22662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839957.027025:0:22662:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e553000/0xad5b343a265745f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265745ee expref: 12 pid: 22672 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.027035:0:22662:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e553000/0xad5b343a265745f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265745ee expref: 12 pid: 22672 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.027048:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553000/0xad5b343a265745f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265745ee expref: 12 pid: 22672 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.027071:0:22662:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.027079:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788839957.027093:0:22662:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005635330s 00010000:00010000:1.0:1788839957.027097:0:22662:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.027105:0:22662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.027112:0:22662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.027119:0:22662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.027124:0:22662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788839957.027128:0:22662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.027136:0:22662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.027147:0:22662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839957.027156:0:22662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839957.027192:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:3616:x1875734060826112:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839957.027199:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788839957.027559:0:22692:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.027569:0:22692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839957.027575:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab781e68600/0xad5b343a26574626 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839957.027607:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060826112:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788839957.046127:0:22656:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:3.0:1788839957.046462:0:22656:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788839957.046645:0:22716:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:1.0:1788839957.046650:0:22716:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1788839957.051462:0:22717:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788839957.051727:0:22656:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:0.0:1788839957.052960:0:22656:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788839957.053002:0:22656:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788839957.054652:0:22656:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788839957.054664:0:22656:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788839957.054728:0:22656:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839957.056075:0:22717:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788839957.057782:0:22718:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8ab7819fa300 x1875734060826240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839957.057798:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00000040:00080000:0.0:1788839957.057974:0:22656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788839957.058705:0:22656:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788839957.058744:0:22656:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788839957.059885:0:22656:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1788839957.060861:0:22656:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000040:00080000:1.0:1788839957.063761:0:22717:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000001:00000004:0.0:1788839957.064628:0:22656:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000004:00080000:1.0:1788839957.064895:0:22717:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00080000:0.0:1788839957.073143:0:22656:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788839957.073189:0:22656:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb69881be3988 00100000:10000000:0.0:1788839957.073197:0:22656:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788839957.075244:0:22656:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788839957.075261:0:22656:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788839957.075281:0:22656:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788839957.075303:0:22656:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788839957.077664:0:22656:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839957.079671:0:22656:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788839957.762618:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839958.078847:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00000040:00080000:1.0:1788839958.080191:0:22712:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788839958.080197:0:22712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788839958.083262:0:22712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788839958.083277:0:22712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1788839958.334948:0:22674:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788839958.334956:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab781e72000 from 11 10000000:01000000:1.0:1788839958.334960:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788839958.335008:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839958.335021:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839958.335032:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839958.335058:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060826368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839958.335128:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839958.335181:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557480 going to sleep for 11 seconds 00000100:00100000:2.0:1788839958.335394:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060826368 00000100:00100000:2.0:1788839958.335408:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060826368 00000100:00100000:2.0:1788839958.335510:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839958.335519:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+11:22674:x1875734060826368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839958.335532:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839958.335545:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de7000/0xad5b343a26574634 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657462d expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839958.335579:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de7000/0xad5b343a26574634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657462d expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839958.335589:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de7000/0xad5b343a26574634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657462d expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839958.335597:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7000, rc 0) 00000100:00100000:2.0:1788839958.335646:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22674:x1875734060826368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839958.335653:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788839958.335728:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060826368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839958.335743:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839958.335752:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839958.335816:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060826496:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788839958.335846:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839958.340457:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557480 going to sleep for 11 seconds 00000100:00100000:0.0:1788839958.342821:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060826496 00000100:00100000:0.0:1788839958.342835:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060826496 00000100:00100000:0.0:1788839958.342898:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788839958.342908:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22674:x1875734060826496:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788839958.342933:0:22672:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788839958.342968:0:22672:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788839958.342971:0:22672:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788839958.343100:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:22674:x1875734060826496:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 193us (7251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839958.343108:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839958.343228:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060826496:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788839958.343281:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839958.343291:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839958.343302:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839958.783942:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839959.102860:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00000040:00080000:1.0:1788839959.103081:0:22712:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788839959.103086:0:22712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788839959.103204:0:22712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788839959.103249:0:22712:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788839959.103396:0:22712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1788839959.808810:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839960.130297:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788839960.834570:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839961.156831:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00000001:02000400:2.0:1788839961.350695:0:22961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788839961.857806:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839962.193905:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00000020:00000004:1.0:1788839962.277718:0:23013:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839962.278152:0:23013:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1788839962.496892:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788839962.496907:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788839962.496919:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab78193a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788839962.496927:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 611 00000100:00080000:1.0:1788839962.496933:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788839962.496940:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ab78193a000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839962.496964:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4c380 x1875734060826752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788839962.496981:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839962.496985:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839962.496987:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839962.496991:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839962.496994:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788839962.496997:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788839962.496999:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab64751c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788839962.497003:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ab64751c800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839962.497014:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4df80 x1875734060826880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839962.497046:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060826752:0@lo:38:kworker.0 00000100:00100000:1.0:1788839962.497179:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839962.497303:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060826880:0@lo:38:kworker.0 00000100:00100000:1.0:1788839962.497331:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839962.497380:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060826752 00000100:00100000:1.0:1788839962.497387:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060826752 00000100:00100000:1.0:1788839962.497417:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839962.497431:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060826752:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788839962.497678:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060826624:0@lo:400:kworker.0 00000100:00100000:0.0:1788839962.497717:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1788839962.498149:0:22682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788839962.498270:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060826752:12345-0@lo:38:kworker.0 Request processed in 837us (1090us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788839962.498278:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788839962.498320:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788839962.498325:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788839962.498330:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060826752:0@lo:38:kworker.0 00000100:00100000:1.0:1788839962.500857:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060826624 00000100:00100000:1.0:1788839962.500875:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060826624 00000100:00100000:1.0:1788839962.500945:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788839962.500955:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:3617:x1875734060826624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839962.501043:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:3617:x1875734060826624:12345-0@lo:400:kworker.0 Request processed in 89us (3325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839962.501050:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839962.501186:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060826624:0@lo:400:kworker.0 00000100:00100000:3.0:1788839962.503273:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060826880 00000100:00100000:3.0:1788839962.503286:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060826880 00000100:00100000:3.0:1788839962.503339:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839962.503348:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875734060826880:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788839962.503376:0:22678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 617 last 0 00000020:00000080:3.0:1788839962.503410:0:22678:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xad5b343a2657463b 00000004:00100000:3.0:1788839962.503426:0:22678:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788839962.506225:0:22678:0:(import.c:65:import_set_state_nolock()) ffff8ab7479d9000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839962.506322:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1875734060826880:12345-0@lo:38:kworker.0 Request processed in 2973us (8988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839962.506332:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788839962.506396:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab646b4df80 x1875734060826880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788839962.506412:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788839962.506420:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788839962.506423:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788839962.506425:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab64751c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788839962.506432:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060826880:0@lo:38:kworker.0 00010000:00010000:1.0:1788839962.879972:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788839963.196659:0:23063:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788839963.196893:0:23063:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788839963.198835:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00010000:00010000:2.0:1788839963.913630:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839964.231918:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788839964.927925:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839965.247839:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788839965.953034:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839966.282878:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00000100:00100000:2.0:1788839966.594945:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839956/real 1788839956] req@ffff8ab7443daa00 x1875734060823808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839966 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839966.594980:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab7443daa00 x1875734060823808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839966 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839966.595024:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839956/real 1788839956] req@ffff8ab7443d9180 x1875734060823680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839966 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839966.595046:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab7443d9180 x1875734060823680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839966 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839966.595065:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839966.595088:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788839966.595092:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060823808:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788839966.595098:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839966.595103:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788839966.595106:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060823680:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788839966.595176:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788839966.595181:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788839966.595183:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab78193a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839966.595187:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 617 00000100:00080000:2.0:1788839966.595191:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788839966.595197:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ab78193a000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839966.595215:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819fbb80 x1875734060827136/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839966.595227:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839966.595230:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788839966.595231:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab78193b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839966.595234:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 611 00000100:00080000:2.0:1788839966.595237:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788839966.595240:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab78193b800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839966.595251:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819f9c00 x1875734060827264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839966.595264:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839966.595267:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788839966.595269:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab78193d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839966.595271:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 611 00000100:00080000:2.0:1788839966.595274:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788839966.595277:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab78193d800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839966.595289:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819f8000 x1875734060827392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839966.595341:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060827008:0@lo:400:kworker.0 00000100:00100000:2.0:1788839966.595402:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839966.595447:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839966.595453:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060827520:0@lo:400:kworker.0 00000100:00100000:2.0:1788839966.595480:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839966.595529:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060827008 00000100:00100000:2.0:1788839966.595535:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060827008 00000100:00100000:2.0:1788839966.595576:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788839966.595584:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:3614:x1875734060827008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839966.595627:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:3614:x1875734060827008:12345-0@lo:400:kworker.0 Request processed in 43us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839966.595633:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788839966.595666:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060827520 00000100:00100000:2.0:1788839966.595669:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060827520 00000100:00100000:2.0:1788839966.595691:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839966.595697:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060827520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839966.595726:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060827520:12345-0@lo:400:kworker.0 Request processed in 29us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839966.595739:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788839966.595795:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab7819f9f80 x1875734060827520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839966.595806:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060827520:0@lo:400:kworker.0 00000100:00100000:2.0:1788839966.595816:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060827008:0@lo:400:kworker.0 00000100:00100000:2.0:1788839966.595834:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060827136:0@lo:38:kworker.0 00000100:00100000:2.0:1788839966.595872:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839966.595908:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060827264:0@lo:8:kworker.0 00000400:00000100:2.0:1788839966.595927:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060827264 offset 0 length 520: 4 00000100:00100000:2.0:1788839966.595937:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060827392:0@lo:8:kworker.0 00000400:00000100:2.0:1788839966.595952:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060827392 offset 0 length 520: 4 00000100:00100000:2.0:1788839966.595976:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060827136 00000100:00100000:2.0:1788839966.595979:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060827136 00000100:00100000:2.0:1788839966.595998:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839966.596003:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060827136:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788839966.596018:0:22682:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788839966.596047:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060827136:12345-0@lo:38:kworker.0 Request processed in 43us (174us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788839966.596053:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788839966.596077:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839966.596081:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788839966.596084:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060827136:0@lo:38:kworker.0 00010000:00010000:1.0:1788839966.979970:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839967.299042:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788839967.999734:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839968.320458:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788839969.023535:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839969.343843:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00000040:00080000:0.0:1788839969.344097:0:22712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788839969.945989:0:23408:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788839969.945993:0:23408:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788839969.945995:0:23408:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788839969.946133:0:23408:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab7467ba000 00000020:01000004:1.0:1788839969.946147:0:23408:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1788839969.946157:0:23408:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788839969.946170:0:23408:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8ab77e4fb370) 00000020:00000080:1.0:1788839969.946190:0:23408:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788839969.999585:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788839970.001972:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.002804:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788839970.003201:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788839970.003356:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788839970.003804:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788839970.004087:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788839970.004270:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788839970.004489:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788839970.004763:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788839970.005138:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788839970.005356:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788839970.005602:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788839970.005988:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788839970.006622:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.007151:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.007316:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.007469:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.007687:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.007928:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.008095:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.008291:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.008627:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.008995:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.009173:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.009373:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.009732:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.010014:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.010186:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.010376:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.010574:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.010746:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.010973:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.011177:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.011347:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.011537:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.011745:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.011968:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.012178:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.012371:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.012567:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.012736:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.012961:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.013167:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788839970.013347:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788839970.013538:0:23408:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00080000:01000000:3.0:1788839970.016127:0:23408:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788839970.016352:0:23408:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788839970.016364:0:23408:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788839970.016376:0:23408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26574649 00000020:01000004:3.0:1788839970.016383:0:23408:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788839970.016402:0:23408:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788839970.016405:0:23408:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788839970.016411:0:23408:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788839970.016452:0:23408:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788839970.016457:0:23408:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788839970.020833:0:23408:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788839970.021007:0:23408:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788839970.021012:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788839970.021014:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788839970.021015:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839970.021017:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839970.021018:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839970.021019:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839970.021021:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839970.021022:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839970.021024:0:23408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839970.021027:0:23408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788839970.021030:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788839970.021031:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788839970.021033:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839970.021034:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839970.021035:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839970.021036:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839970.021037:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839970.021038:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839970.021039:0:23408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839970.021067:0:23408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788839970.021087:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060827648:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788839970.021158:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839970.021264:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab778b88480 going to sleep for 11 seconds 00000100:00100000:1.0:1788839970.021305:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060827648 00000100:00100000:1.0:1788839970.021312:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060827648 00000100:00100000:1.0:1788839970.021376:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788839970.021386:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:23408:x1875734060827648:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788839970.021426:0:22669:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788839970.021429:0:22669:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788839970.021437:0:22669:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788839970.022360:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:23408:x1875734060827648:12345-0@lo:253:mount.lustre.0 Request processed in 973us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.022369:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788839970.022583:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060827648:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788839970.022594:0:23408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788839970.022596:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839970.022598:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788839970.022600:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839970.022601:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839970.022603:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839970.022605:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839970.022606:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839970.022616:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839970.022617:0:23408:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788839970.022633:0:23408:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab7467ba000 from lustre-MDT0001 10000000:01000000:3.0:1788839970.022662:0:23408:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788839970.022665:0:23408:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788839970.022672:0:23408:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab6419419b8 local copy 00010000:00010000:3.0:1788839970.022682:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839970.022939:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060827776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839970.022973:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839970.023050:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab778b88b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839970.023085:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060827776 00000100:00100000:2.0:1788839970.023091:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060827776 00000100:00100000:2.0:1788839970.023158:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839970.023166:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:23408:x1875734060827776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839970.023240:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:23408:x1875734060827776:12345-0@lo:501:mount.lustre.0 Request processed in 74us (265us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788839970.023257:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788839970.023283:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060827776:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788839970.023299:0:23408:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788839970.023321:0:23408:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788839970.023328:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.023337:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839970.023361:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab7467ba000 10000000:01000000:0.0:1788839970.023365:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788839970.023369:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ab6419419b8 10000000:01000000:0.0:1788839970.023372:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788839970.023375:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ab6419419b8 from 1 10000000:01000000:0.0:1788839970.023378:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788839970.023403:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e68800/0xad5b343a26574650 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.023416:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab781e68800/0xad5b343a26574650 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.023425:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab781e68800/0xad5b343a26574650 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839970.023437:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060827904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839970.023465:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839970.023484:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839970.023557:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060827904 00000100:00100000:1.0:1788839970.023562:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060827904 00000100:00100000:1.0:1788839970.023623:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788839970.023630:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+12:23408:x1875734060827904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839970.023639:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839970.023654:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab741464400/0xad5b343a26574657 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574650 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.023677:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab741464400/0xad5b343a26574657 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574650 expref: 13 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.023688:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab741464400/0xad5b343a26574657 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574650 expref: 13 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.023697:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab741464400, rc 0) 00000100:00100000:1.0:1788839970.023747:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+13:23408:x1875734060827904:12345-0@lo:101:mount.lustre.0 Request processed in 117us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.023753:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788839970.023853:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060827904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839970.023874:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab781e68800/0xad5b343a26574650 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574657 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.023882:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab781e68800/0xad5b343a26574650 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574657 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839970.023898:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788839970.023919:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e68800/0xad5b343a26574650 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574657 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.023926:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab781e68800/0xad5b343a26574650 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574657 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839970.023933:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ab7467ba000 10000000:01000000:0.0:1788839970.023937:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788839970.023942:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ab7467ba000 from 1 10000000:01000000:0.0:1788839970.023944:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788839970.023967:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69e00/0xad5b343a2657465e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.023975:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab781e69e00/0xad5b343a2657465e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.023982:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab781e69e00/0xad5b343a2657465e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839970.023993:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839970.024019:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839970.024050:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839970.024098:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060828032 00000100:00100000:3.0:1788839970.024102:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060828032 00000100:00100000:3.0:1788839970.024130:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788839970.024138:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+13:23408:x1875734060828032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839970.024146:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839970.024156:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552000/0xad5b343a26574665 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657465e expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.024171:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552000/0xad5b343a26574665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657465e expref: 14 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.024178:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552000/0xad5b343a26574665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657465e expref: 14 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.024185:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552000, rc 0) 00000100:00100000:3.0:1788839970.024262:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+14:23408:x1875734060828032:12345-0@lo:101:mount.lustre.0 Request processed in 125us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839970.024268:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788839970.024318:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839970.024328:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab781e69e00/0xad5b343a2657465e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574665 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.024336:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab781e69e00/0xad5b343a2657465e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574665 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839970.024346:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788839970.024361:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69e00/0xad5b343a2657465e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574665 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.024368:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab781e69e00/0xad5b343a2657465e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574665 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839970.024375:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788839970.024378:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788839970.024382:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ab7467ba000 10000000:01000000:0.0:1788839970.024391:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788839970.024394:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788839970.024396:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788839970.024409:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e68a00/0xad5b343a2657466c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.024416:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab781e68a00/0xad5b343a2657466c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.024423:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab781e68a00/0xad5b343a2657466c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839970.024433:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839970.024455:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839970.024469:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839970.024581:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060828160 00000100:00100000:1.0:1788839970.024586:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060828160 00000100:00100000:1.0:1788839970.024617:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788839970.024623:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+14:23408:x1875734060828160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839970.024630:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839970.024639:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab741465400/0xad5b343a26574673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657466c expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.024655:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab741465400/0xad5b343a26574673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657466c expref: 15 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.024664:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab741465400/0xad5b343a26574673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657466c expref: 15 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.024672:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab741465400, rc 0) 00000100:00100000:1.0:1788839970.024710:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:23408:x1875734060828160:12345-0@lo:101:mount.lustre.0 Request processed in 86us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.024717:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839970.024720:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839970.024731:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab781e68a00/0xad5b343a2657466c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574673 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.024738:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab781e68a00/0xad5b343a2657466c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574673 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839970.029345:0:23408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1788839970.030163:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839970.033432:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788839970.033483:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1788839970.033495:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1788839970.033506:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1788839970.033517:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1788839970.033529:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1788839970.033549:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1788839970.033562:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1788839970.033572:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1788839970.033583:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1788839970.033593:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1788839970.033604:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1788839970.033614:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1788839970.033625:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1788839970.033635:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1788839970.033646:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1788839970.033657:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1788839970.033667:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1788839970.033678:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1788839970.033688:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1788839970.033699:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1788839970.033709:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1788839970.033720:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1788839970.033731:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1788839970.033742:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1788839970.033753:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1788839970.033763:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1788839970.033922:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1788839970.033937:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1788839970.033948:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1788839970.033959:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1788839970.033969:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1788839970.033979:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1788839970.033990:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1788839970.034000:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1788839970.034010:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1788839970.034021:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1788839970.034031:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1788839970.034042:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1788839970.034061:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1788839970.034072:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1788839970.034083:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1788839970.034094:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1788839970.034106:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1788839970.034133:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1788839970.034138:0:23408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1788839970.034245:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839970.034311:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839970.034436:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839970.034578:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060828288 00000100:00100000:3.0:1788839970.034586:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060828288 00000100:00100000:3.0:1788839970.034685:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839970.034695:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:23408:x1875734060828288:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839970.034875:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:23408:x1875734060828288:12345-0@lo:501:mount.lustre.0 Request processed in 181us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839970.034882:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788839970.034976:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839970.035009:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839970.035045:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839970.035072:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839970.035099:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060828416 00000100:00100000:3.0:1788839970.035105:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060828416 00000100:00100000:3.0:1788839970.035139:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788839970.035148:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:23408:x1875734060828416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839970.035973:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:23408:x1875734060828416:12345-0@lo:503:mount.lustre.0 Request processed in 825us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839970.035982:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788839970.036006:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828416:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788839970.036340:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839970.036398:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839970.036431:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839970.036461:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839970.037606:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060828544 00000100:00100000:3.0:1788839970.037616:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060828544 00000100:00100000:3.0:1788839970.037659:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788839970.037667:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:23408:x1875734060828544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839970.040238:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:23408:x1875734060828544:12345-0@lo:502:mount.lustre.0 Request processed in 2563us (3798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839970.040251:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839970.040349:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839970.040727:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788839970.040757:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1788839970.040802:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1788839970.040820:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1788839970.040835:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1788839970.040854:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1788839970.040885:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1788839970.040910:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1788839970.040924:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1788839970.040937:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1788839970.040948:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1788839970.040961:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1788839970.040975:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1788839970.040990:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1788839970.041004:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1788839970.041015:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1788839970.041028:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1788839970.041041:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1788839970.041056:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1788839970.041069:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1788839970.041083:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1788839970.041096:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1788839970.041107:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1788839970.041120:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1788839970.041132:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1788839970.041144:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1788839970.041156:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1788839970.041171:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1788839970.041187:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1788839970.041201:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1788839970.041213:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1788839970.041224:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1788839970.041297:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1788839970.041312:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1788839970.041324:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1788839970.041337:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1788839970.041350:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1788839970.041362:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1788839970.041374:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1788839970.041387:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1788839970.041475:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1788839970.041491:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1788839970.041506:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1788839970.041521:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1788839970.041560:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839970.041614:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839970.041659:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839970.041719:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060828672 00000100:00100000:3.0:1788839970.041725:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060828672 00000100:00100000:3.0:1788839970.041811:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788839970.041900:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:23408:x1875734060828672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839970.042002:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:23408:x1875734060828672:12345-0@lo:502:mount.lustre.0 Request processed in 108us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839970.042019:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788839970.042124:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060828672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839970.042169:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1788839970.042177:0:23408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788839970.043197:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839970.043208:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839970.043210:0:23412:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788839970.043215:0:23412:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788839970.043219:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788839970.043233:0:23412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8ab6479e8000) 00000020:00000080:0.0:1788839970.043250:0:23412:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788839970.043257:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788839970.043321:0:23412:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788839970.043328:0:23412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26574681 00000020:00000080:1.0:1788839970.043540:0:23412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788839970.043543:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839970.043546:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839970.043547:0:23412:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788839970.043550:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839970.043552:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839970.043553:0:23412:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788839970.043555:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839970.043561:0:23412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8ab77e790000) 00000020:00000080:1.0:1788839970.043570:0:23412:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788839970.043573:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788839970.043574:0:23412:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788839970.043576:0:23412:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788839970.043585:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788839970.043625:0:23412:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab7467ba000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788839970.043633:0:23412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8ab77e7919b8) 00000020:00000080:1.0:1788839970.043639:0:23412:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788839970.043690:0:23412:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788839970.043694:0:23412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26574696 00000020:00000080:1.0:1788839970.043757:0:23412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788839970.043762:0:23412:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788839970.043764:0:23412:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xad5b343a2657469d 00080000:01000000:1.0:1788839970.043785:0:23412:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788839970.043790:0:23412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a265746a4 00010000:00010000:0.0:1788839970.053170:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839970.089938:0:23412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788839970.090369:0:23412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:1.0:1788839970.090651:0:23412:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788839970.091996:0:23412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788839970.092008:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839970.092015:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839970.092017:0:23412:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788839970.092022:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839970.092030:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839970.092032:0:23412:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788839970.092036:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788839970.092041:0:23412:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:00000080:0.0:1788839970.092073:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788839970.092096:0:23412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8ab6479eb370) 00000020:00000080:0.0:1788839970.092118:0:23412:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788839970.092125:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788839970.092249:0:23412:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788839970.092255:0:23412:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788839970.092262:0:23412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a265746b2 00010000:00080000:0.0:1788839970.092294:0:23412:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab7766f5000@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788839970.094082:0:23412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788839970.094962:0:23412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788839970.094976:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788839970.095017:0:23412:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788839970.095049:0:23412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a265746b9 00000100:00080000:1.0:1788839970.095059:0:23412:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839970.095065:0:23412:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ab7766f5000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839970.095097:0:23412:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4c380 x1875734060828800/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788839970.095116:0:23412:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788839970.095147:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060828800:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788839970.095187:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839970.095192:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839970.095195:0:23412:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000100:00080000:0.0:1788839970.095207:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000020:01000000:1.0:1788839970.095215:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000100:00080000:0.0:1788839970.095215:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788839970.095218:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab78193a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000020:01000000:1.0:1788839970.095220:0:23412:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000100:00100000:2.0:1788839970.095221:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788839970.095224:0:23412:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839970.095226:0:23412:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839970.095228:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000100:00080000:0.0:1788839970.095229:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 621 00000100:00080000:0.0:1788839970.095235:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000020:00000080:1.0:1788839970.095239:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:0.0:1788839970.095242:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ab78193a000 using connection 192.168.203.152@tcp/0@lo 00000020:00000080:1.0:1788839970.095243:0:23412:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788839970.095250:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839970.095256:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839970.095257:0:23412:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788839970.095262:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788839970.095264:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6476b0380 x1875734060829056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839970.095283:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060828800 00000100:00080000:0.0:1788839970.095284:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839970.095289:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788839970.095291:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060828800 00000004:01000000:1.0:1788839970.095292:0:23412:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00080000:0.0:1788839970.095292:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839970.095298:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788839970.095321:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:2.0:1788839970.095324:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000020:00000080:1.0:1788839970.095326:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839970.095327:0:23412:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788839970.095330:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788839970.095332:0:23412:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000100:00100000:0.0:1788839970.095332:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060828928:0@lo:400:kworker.0 00000100:00100000:2.0:1788839970.095333:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060828800:12345-0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788839970.095336:0:23412:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839970.095339:0:23412:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839970.095342:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788839970.095345:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839970.095347:0:23412:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788839970.095349:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788839970.095352:0:23412:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788839970.095356:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00010000:00080000:2.0:1788839970.095358:0:22682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 625 last 0 00000020:00000080:1.0:1788839970.095358:0:23412:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788839970.095361:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788839970.095365:0:23412:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000100:00100000:0.0:1788839970.095381:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788839970.095387:0:23412:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788839970.095390:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839970.095391:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a265746c0 00000020:00000080:1.0:1788839970.095401:0:23412:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8ab77e794d28) 00000004:00100000:2.0:1788839970.095407:0:22682:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:1.0:1788839970.095412:0:23412:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000001:00000004:2.0:1788839970.095413:0:22682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1788839970.095413:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00000080:1.0:1788839970.095417:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788839970.095424:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060829184:0@lo:400:kworker.0 00000100:00100000:0.0:1788839970.095473:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788839970.095474:0:23412:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00000100:00100000:2.0:1788839970.095486:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060829056:0@lo:38:kworker.0 00080000:01000000:1.0:1788839970.095493:0:23412:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788839970.095499:0:23412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a265746ce 00000100:00100000:2.0:1788839970.095516:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788839970.095536:0:23412:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab744349000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.152@tcp at head 00000100:00100000:0.0:1788839970.095589:0:22681:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788839970.095597:0:22681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00010000:1.0:1788839970.095733:0:23412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1788839970.096247:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060829056 00000100:00100000:2.0:1788839970.096253:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060829056 00000100:00100000:0.0:1788839970.096334:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839970.096339:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060828928 00000100:00100000:0.0:1788839970.096343:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3613:x1875734060829056:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788839970.096346:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060828928 00000100:00100000:0.0:1788839970.096399:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3613:x1875734060829056:12345-0@lo:38:kworker.0 Request processed in 57us (883us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788839970.096408:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839970.096433:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839970.096441:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193a000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839970.096445:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788839970.096448:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060829056:0@lo:38:kworker.0 00000100:00100000:3.0:1788839970.096639:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788839970.096647:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:3616:x1875734060828928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839970.096783:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:3616:x1875734060828928:12345-0@lo:400:kworker.0 Request processed in 122us (1388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839970.096791:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788839970.096825:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060829184 00000100:00100000:3.0:1788839970.096830:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060829184 00000100:00100000:3.0:1788839970.096875:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839970.096881:0:22677:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788839970.096885:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060829184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839970.096892:0:22677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788839970.096926:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060829184:12345-0@lo:400:kworker.0 Request processed in 43us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839970.096932:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788839970.097157:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab6476b0000 x1875734060829184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839970.097169:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060829184:0@lo:400:kworker.0 00000100:00100000:0.0:1788839970.097179:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060828928:0@lo:400:kworker.0 00000040:01000000:1.0:1788839970.097309:0:23412:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788839970.097508:0:23412:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788839970.099305:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839970.099576:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788839970.099719:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788839970.100672:0:23419:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788839970.100677:0:23419:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1788839970.100758:0:22682:0:(import.c:65:import_set_state_nolock()) ffff8ab646524000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839970.100891:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3613:x1875734060828800:12345-0@lo:38:llog_process_th.0 Request processed in 5556us (5669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.100904:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839970.100920:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788839970.100931:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788839970.100941:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788839970.100946:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788839970.100949:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab7766f5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788839970.100961:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060828800:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788839970.101088:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839970.101109:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060829312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839970.101148:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839970.101184:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060829312 00000100:00100000:3.0:1788839970.101191:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060829312 00000100:00100000:3.0:1788839970.101238:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839970.101247:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875734060829312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839970.101271:0:22681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788839970.101315:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875734060829312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839970.101322:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839970.101384:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060829312:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1788839970.101584:0:23412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788839970.101598:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788839970.101641:0:23412:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788839970.101661:0:23412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a265746d5 00000100:00080000:1.0:1788839970.101669:0:23412:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839970.101673:0:23412:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ab744349000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839970.101696:0:23412:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4dc00 x1875734060829440/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839970.101747:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060829440:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788839970.101803:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060829440 offset 0 length 520: 4 00000100:00080000:1.0:1788839970.101936:0:23412:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788839970.101988:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839970.101993:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839970.101996:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839970.101998:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788839970.102045:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839970.102050:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839970.102052:0:23412:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788839970.102056:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788839970.102059:0:23412:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788839970.102061:0:23412:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839970.102063:0:23412:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839970.102065:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788839970.102068:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839970.102069:0:23412:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788839970.102072:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788839970.102082:0:23412:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788839970.102086:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839970.102088:0:23412:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788839970.102093:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788839970.102097:0:23412:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:1.0:1788839970.102121:0:23412:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788839970.102123:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839970.102135:0:23412:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8ab77e793370) 00000020:00000080:1.0:1788839970.102149:0:23412:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788839970.102155:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788839970.102489:0:23412:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788839970.102495:0:23412:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788839970.102502:0:23412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a265746e3 00010000:00080000:1.0:1788839970.102529:0:23412:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6479d5800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788839970.102717:0:23412:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788839970.103021:0:23412:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788839970.103036:0:23412:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788839970.105264:0:23412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839970.106076:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788839970.106216:0:23412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788839970.106615:0:23421:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788839970.106621:0:23421:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788839970.108097:0:23412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788839970.108110:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788839970.108149:0:23412:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788839970.108169:0:23412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a265746ea 00000100:00080000:2.0:1788839970.108179:0:23412:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839970.108185:0:23412:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ab6479d5800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839970.108219:0:23412:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819f9500 x1875734060829568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839970.108250:0:23412:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788839970.108392:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839970.108398:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839970.108401:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839970.108404:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788839970.108427:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060829568:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788839970.108477:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060829568 offset 0 length 520: 4 00000020:01000000:2.0:1788839970.108588:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839970.108592:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839970.108594:0:23412:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788839970.108597:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839970.108601:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839970.108602:0:23412:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788839970.108604:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788839970.108606:0:23412:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788839970.108608:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839970.108611:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839970.108612:0:23412:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788839970.108614:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839970.108616:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839970.108617:0:23412:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788839970.108621:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788839970.108649:0:23412:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839970.108652:0:23412:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839970.108653:0:23412:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788839970.108662:0:23412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1788839970.108853:0:23408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788839970.108895:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788839970.108913:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e68a00/0xad5b343a2657466c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574673 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.108931:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab781e68a00/0xad5b343a2657466c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574673 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839970.108940:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab7467ba000 from 1 10000000:01000000:0.0:1788839970.108943:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788839970.108969:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.108977:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.108987:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839970.109003:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060829696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839970.109039:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839970.109066:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839970.109093:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060829696 00000100:00100000:1.0:1788839970.109101:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060829696 00000100:00100000:1.0:1788839970.109150:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788839970.109159:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+15:23408:x1875734060829696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839970.109181:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839970.109195:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab741465600/0xad5b343a265746f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265746f1 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.109220:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab741465600/0xad5b343a265746f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265746f1 expref: 16 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.109231:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab741465600/0xad5b343a265746f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265746f1 expref: 16 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.109240:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab741465600, rc 0) 00000100:00100000:1.0:1788839970.109291:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+16:23408:x1875734060829696:12345-0@lo:101:mount.lustre.0 Request processed in 133us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.109298:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788839970.109351:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060829696:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839970.109365:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.109374:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839970.110364:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060829824:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788839970.110413:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.110448:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4ae600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839970.110466:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060829824 00000100:00100000:2.0:1788839970.110473:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060829824 00000100:00100000:2.0:1788839970.110515:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788839970.110524:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+16:23408:x1875734060829824:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788839970.110541:0:22670:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788839970.110557:0:22670:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788839970.110561:0:22670:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788839970.110656:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+16:23408:x1875734060829824:12345-0@lo:256:mount.lustre.0 Request processed in 132us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.110665:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788839970.110670:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060829824:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788839970.111547:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839970.111599:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.111613:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839970.111619:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab7467ba000 from 1 10000000:01000000:1.0:1788839970.111621:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839970.111643:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.111648:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.111655:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839970.111669:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060829952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788839970.111702:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.111757:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4ae600 going to sleep for 11 seconds 00000100:00100000:1.0:1788839970.111800:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060829952 00000100:00100000:1.0:1788839970.111806:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060829952 00000100:00100000:1.0:1788839970.111840:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788839970.111871:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+16:23408:x1875734060829952:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839970.111882:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839970.111896:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab741464800/0xad5b343a26574706 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265746ff expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.111918:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab741464800/0xad5b343a26574706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265746ff expref: 17 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.111940:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab741464800/0xad5b343a26574706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265746ff expref: 17 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.111949:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab741464800, rc 0) 00000100:00100000:1.0:1788839970.112004:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:23408:x1875734060829952:12345-0@lo:101:mount.lustre.0 Request processed in 144us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.112013:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788839970.112079:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060829952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839970.112096:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.112105:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839970.113145:0:23408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1788839970.113440:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839970.113565:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788839970.113581:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1788839970.113589:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1788839970.113596:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1788839970.113602:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1788839970.113609:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1788839970.113616:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1788839970.113622:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1788839970.113629:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1788839970.113636:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1788839970.113642:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1788839970.113651:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1788839970.113659:0:23408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1788839970.113706:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839970.113759:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.113822:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839970.114012:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060830080 00000100:00100000:2.0:1788839970.114029:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060830080 00000100:00100000:2.0:1788839970.114069:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788839970.114078:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:23408:x1875734060830080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839970.114187:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:23408:x1875734060830080:12345-0@lo:501:mount.lustre.0 Request processed in 109us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.114194:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788839970.114273:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839970.114300:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830208:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839970.114339:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.114369:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839970.114384:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060830208 00000100:00100000:2.0:1788839970.114389:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060830208 00000100:00100000:2.0:1788839970.114416:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788839970.114423:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:23408:x1875734060830208:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839970.114496:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:23408:x1875734060830208:12345-0@lo:503:mount.lustre.0 Request processed in 73us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.114504:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788839970.114528:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830208:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788839970.114947:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839970.115002:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839970.115038:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.115068:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4ae600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839970.115114:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060830336 00000100:00100000:2.0:1788839970.115119:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060830336 00000100:00100000:2.0:1788839970.115148:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788839970.115161:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:23408:x1875734060830336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839970.115222:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:23408:x1875734060830336:12345-0@lo:502:mount.lustre.0 Request processed in 61us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.115229:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839970.115260:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839970.115437:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788839970.115455:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1788839970.115463:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1788839970.115470:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1788839970.115476:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1788839970.115483:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1788839970.115490:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1788839970.115507:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1788839970.115516:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788839970.115523:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1788839970.115530:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1788839970.115546:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839970.115573:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839970.115589:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74515df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839970.115605:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060830464 00000100:00100000:2.0:1788839970.115609:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060830464 00000100:00100000:2.0:1788839970.115637:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788839970.115643:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:23408:x1875734060830464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839970.115752:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:23408:x1875734060830464:12345-0@lo:502:mount.lustre.0 Request processed in 109us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.115759:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788839970.115980:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443dbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830464:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839970.116024:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:1.0:1788839970.116033:0:23408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788839970.116549:0:23423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839970.116559:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839970.116561:0:23423:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788839970.116568:0:23423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab7467ba000 00000020:00000080:0.0:1788839970.116571:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839970.116577:0:23423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839970.116580:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839970.116581:0:23423:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788839970.116583:0:23423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839970.116586:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839970.116588:0:23423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788839970.116591:0:23423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab7467ba000 00000020:00000080:0.0:1788839970.116593:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839970.116701:0:23423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839970.116705:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839970.116707:0:23423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788839970.116709:0:23423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839970.116712:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839970.116714:0:23423:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788839970.116717:0:23423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab7467ba000 00000020:00000080:0.0:1788839970.116719:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839970.118203:0:23423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839970.118213:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839970.118216:0:23423:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788839970.118220:0:23423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839970.118224:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839970.118226:0:23423:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788839970.118242:0:23423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab7467ba000 00000020:00000080:0.0:1788839970.118246:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839970.118299:0:23423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839970.118303:0:23423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839970.118305:0:23423:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788839970.118309:0:23423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1788839970.119834:0:23408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788839970.119892:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839970.119911:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.119924:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839970.119995:0:23408:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788839970.119998:0:23408:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab7467ba000 10000000:01000000:1.0:1788839970.120007:0:23408:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab7467ba000 10000000:01000000:1.0:1788839970.120012:0:23408:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839970.120018:0:23408:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab7467ba000 from 1 10000000:01000000:1.0:1788839970.120021:0:23408:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788839970.120057:0:23408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741465c00/0xad5b343a2657470d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.120066:0:23408:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab741465c00/0xad5b343a2657470d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.120077:0:23408:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab741465c00/0xad5b343a2657470d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839970.120103:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830592:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788839970.120166:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.120206:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060830592 00000100:00100000:1.0:1788839970.120213:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060830592 00000100:00100000:1.0:1788839970.120257:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788839970.120266:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:23408:x1875734060830592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839970.120279:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839970.120290:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab741465a00/0xad5b343a26574714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657470d expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.120312:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab741465a00/0xad5b343a26574714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657470d expref: 18 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.120322:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab741465a00/0xad5b343a26574714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657470d expref: 18 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.120331:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab741465a00, rc 0) 00000100:00100000:1.0:1788839970.120371:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060830592:12345-0@lo:101:mount.lustre.0 Request processed in 106us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.120378:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788839970.120423:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839970.120443:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830592:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839970.120456:0:23408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab741465c00/0xad5b343a2657470d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574714 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.120464:0:23408:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab741465c00/0xad5b343a2657470d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574714 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839970.122686:0:23408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1788839970.122992:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839970.123182:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1788839970.123209:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1788839970.123228:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1788839970.123247:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1788839970.123264:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1788839970.123283:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1788839970.123300:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1788839970.123331:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1788839970.123349:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1788839970.123362:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1788839970.123374:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1788839970.123387:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1788839970.123401:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1788839970.123414:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1788839970.123435:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1788839970.123450:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1788839970.123463:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1788839970.123476:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1788839970.123504:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1788839970.123519:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1788839970.123531:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1788839970.123543:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1788839970.123556:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1788839970.123584:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1788839970.123600:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1788839970.123614:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1788839970.123627:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1788839970.123640:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1788839970.123653:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1788839970.123665:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1788839970.123678:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1788839970.123691:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1788839970.123705:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1788839970.123716:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1788839970.123729:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1788839970.123744:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1788839970.123756:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1788839970.123787:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1788839970.123806:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1788839970.123834:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1788839970.123850:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1788839970.123874:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1788839970.123887:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1788839970.123900:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1788839970.123916:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1788839970.123930:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1788839970.123949:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1788839970.123965:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1788839970.124099:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1788839970.124123:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1788839970.124144:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1788839970.124159:0:23408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1788839970.124245:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839970.124313:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.124357:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4ae000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839970.124520:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060830720 00000100:00100000:2.0:1788839970.124528:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060830720 00000100:00100000:2.0:1788839970.124577:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788839970.124587:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060830720:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839970.124700:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060830720:12345-0@lo:501:mount.lustre.0 Request processed in 114us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.124708:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788839970.125985:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839970.126038:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839970.126096:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.126132:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4ae000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839970.126197:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060830848 00000100:00100000:2.0:1788839970.126203:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060830848 00000100:00100000:2.0:1788839970.126242:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788839970.126251:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060830848:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839970.126364:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060830848:12345-0@lo:503:mount.lustre.0 Request processed in 113us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.126371:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788839970.126457:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830848:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788839970.128925:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839970.129012:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839970.129084:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.129125:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839970.129958:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060830976 00000100:00100000:0.0:1788839970.129967:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060830976 00000100:00100000:0.0:1788839970.130032:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788839970.130042:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060830976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839970.130168:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060830976:12345-0@lo:502:mount.lustre.0 Request processed in 128us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839970.130175:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788839970.130330:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060830976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839970.130529:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1788839970.130568:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1788839970.130586:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1788839970.130598:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1788839970.130611:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1788839970.130622:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1788839970.130634:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1788839970.130645:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1788839970.130657:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1788839970.130668:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1788839970.130679:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1788839970.130692:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1788839970.130704:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1788839970.130725:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1788839970.130739:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1788839970.130752:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1788839970.130764:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1788839970.130809:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1788839970.130825:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1788839970.130836:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1788839970.131973:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1788839970.132000:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1788839970.132014:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1788839970.132027:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1788839970.132042:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1788839970.132056:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1788839970.132070:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1788839970.132083:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1788839970.132096:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1788839970.132111:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1788839970.132124:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1788839970.132138:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1788839970.132152:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1788839970.132180:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1788839970.132196:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1788839970.132210:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1788839970.132224:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1788839970.132238:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1788839970.132251:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1788839970.132265:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1788839970.132279:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1788839970.132292:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1788839970.132306:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1788839970.132321:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1788839970.132554:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1788839970.132575:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1788839970.132599:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1788839970.132614:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1788839970.132676:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060831104:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839970.132744:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839970.132803:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060831104 00000100:00100000:1.0:1788839970.132811:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839970.132813:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060831104 00000100:00100000:2.0:1788839970.132874:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788839970.132883:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060831104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839970.132988:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060831104:12345-0@lo:502:mount.lustre.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.132995:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839970.134000:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060831104:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839970.134214:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1788839970.134241:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1788839970.134272:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060831232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839970.134324:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.134369:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839970.134612:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060831232 00000100:00100000:0.0:1788839970.134618:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060831232 00000100:00100000:0.0:1788839970.134662:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788839970.134675:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060831232:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839970.134818:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060831232:12345-0@lo:502:mount.lustre.0 Request processed in 148us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839970.134826:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839970.135005:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060831232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839970.135051:0:23408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1788839970.135060:0:23408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788839970.138565:0:23428:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788839970.138582:0:23428:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8ab6479ecd28) 00000020:00000080:0.0:1788839970.138605:0:23428:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788839970.138707:0:23428:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab7467ba000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788839970.138711:0:23428:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab7467ba000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788839970.138714:0:23428:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab7467ba000 3 00010000:00080000:0.0:1788839970.138872:0:23428:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab777b8e000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788839970.141011:0:23428:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788839970.141212:0:23428:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788839970.141253:0:23428:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788839970.141266:0:23428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xad5b343a26574722 00000100:00080000:1.0:1788839970.141275:0:23428:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839970.141282:0:23428:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ab777b8e000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839970.141316:0:23428:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4ca80 x1875734060831360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839970.141353:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060831360:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788839970.141417:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788839970.141467:0:23428:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788839970.141497:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839970.141506:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839970.141509:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839970.141511:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788839970.141654:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060831360 00000100:00100000:2.0:1788839970.141662:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060831360 00000100:00100000:2.0:1788839970.141693:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839970.141701:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060831360:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788839970.141722:0:22676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 625 last 0 00000020:00000080:2.0:1788839970.141750:0:22676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xad5b343a26574729 00000004:00100000:2.0:1788839970.141765:0:22676:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788839970.141822:0:22676:0:(import.c:65:import_set_state_nolock()) ffff8ab646536800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839970.141953:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1875734060831360:12345-0@lo:38:llog_process_th.0 Request processed in 251us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.141960:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788839970.142245:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab646b4ca80 x1875734060831360/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839980 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839970.142255:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788839970.142262:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788839970.142269:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788839970.142273:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788839970.142276:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab777b8e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788839970.142282:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060831360:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788839970.142381:0:23428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1788839970.142470:0:23408:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788839970.142500:0:23408:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788839970.142514:0:23408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741465c00/0xad5b343a2657470d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574714 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.142524:0:23408:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab741465c00/0xad5b343a2657470d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574714 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788839970.142574:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788839970.142577:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788839970.142578:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839970.142580:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839970.142581:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839970.142583:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839970.142584:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788839970.142586:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839970.142591:0:23408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839970.142594:0:23408:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788839970.142597:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788839970.142598:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788839970.142599:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839970.142600:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839970.142601:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839970.142602:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839970.142603:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788839970.142604:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839970.142604:0:23408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839970.142620:0:23408:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788839970.142634:0:23408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060831488:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788839970.142670:0:23408:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.142695:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060831488 00000100:00100000:1.0:1788839970.142700:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060831488 00000100:00100000:1.0:1788839970.142731:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839970.142738:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060831488:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788839970.142759:0:22672:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788839970.142792:0:22672:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788839970.143848:0:23408:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aed80 going to sleep for 11 seconds 00000001:00100000:2.0:1788839970.147336:0:22657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788839970.147477:0:22672:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788839970.147493:0:22672:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788839970.147669:0:22692:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788839970.147674:0:22692:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788839970.147694:0:22692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839970.147711:0:22692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab777de7000/0xad5b343a26574634 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657462d expref: 18 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839970.147718:0:22692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab741465600/0xad5b343a265746f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265746f1 expref: 18 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839970.148000:0:22692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839970.148263:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:23408:x1875734060831488:12345-0@lo:253:mount.lustre.0 Request processed in 5523us (5589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.148274:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1788839970.148351:0:22692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab741465600/0xad5b343a265746f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265746f1 expref: 17 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839970.148371:0:22692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab741465600/0xad5b343a265746f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265746f1 expref: 17 pid: 22669 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839970.148384:0:22692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060831616:0@lo:104: 00000100:00100000:3.0:1788839970.148394:0:23408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:23408:1875734060831488:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788839970.148405:0:23408:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788839970.148408:0:23408:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839970.148410:0:23408:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788839970.148411:0:23408:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839970.148412:0:23408:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839970.148413:0:23408:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839970.148415:0:23408:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839970.148416:0:23408:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000100:00100000:2.0:1788839970.148417:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788839970.148418:0:23408:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839970.148419:0:23408:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788839970.148431:0:23408:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788839970.148462:0:22692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab777de7000/0xad5b343a26574634 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a2657462d expref: 17 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839970.148469:0:22692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab777de7000/0xad5b343a26574634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a2657462d expref: 17 pid: 22670 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839970.148477:0:22692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060831744:0@lo:104: 00000100:00100000:2.0:1788839970.148509:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839970.148561:0:22692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746a529c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839970.150233:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060831616 00000100:00100000:1.0:1788839970.150243:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060831616 00000100:00100000:1.0:1788839970.150274:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060831744 00000100:00100000:1.0:1788839970.150276:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060831744 00000100:00100000:1.0:1788839970.150288:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839970.150295:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+4:22692:x1875734060831616:12345-0@lo:104: 00010000:00010000:1.0:1788839970.150310:0:22660:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150385:0:22660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839970.150390:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+4:22692:x1875734060831616:12345-0@lo:104: Request processed in 96us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.150397:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839970.150412:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839970.150417:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:22692:x1875734060831744:12345-0@lo:104: 00010000:00010000:1.0:1788839970.150423:0:22660:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150452:0:22660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788839970.150456:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:22692:x1875734060831744:12345-0@lo:104: Request processed in 40us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.150461:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788839970.150477:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788839970.150482:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150489:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68000 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839970.150493:0:22666:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150502:0:22666:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839970.150509:0:22666:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839970.150515:0:22666:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788839970.150548:0:22666:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150554:0:22666:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839970.150572:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150578:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a265746f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265746f8 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150588:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839970.150591:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150596:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741464000 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839970.150599:0:22666:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150605:0:22666:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839970.150611:0:22666:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839970.150616:0:22666:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788839970.150627:0:22666:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150632:0:22666:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839970.150645:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150660:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a2657462d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574634 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150673:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839970.150675:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839970.150676:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839970.150681:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839970.150693:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3615:1875734060831872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839970.150738:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.150807:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060832000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839970.150829:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839970.150879:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060831872 00000100:00100000:1.0:1788839970.150884:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060831872 00010000:00010000:1.0:1788839970.150901:0:22662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab741465600/0xad5b343a265746f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265746f1 expref: 18 pid: 22669 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839970.150924:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060832000 00000100:00100000:1.0:1788839970.150926:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060832000 00010000:00010000:1.0:1788839970.150935:0:22662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab777de7000/0xad5b343a26574634 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657462d expref: 19 pid: 22670 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839970.150945:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839970.150950:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:3615:x1875734060831872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839970.150959:0:22662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839970.150963:0:22662:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab741465600/0xad5b343a265746f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265746f1 expref: 19 pid: 22669 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150982:0:22662:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab741465600/0xad5b343a265746f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265746f1 expref: 19 pid: 22669 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839970.150995:0:22662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839970.151016:0:22663:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788839970.151025:0:22663:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788839970.151064:0:22664:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788839970.151073:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839970.151080:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:3616:x1875734060832000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839970.151097:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839970.151101:0:22664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab777de7000/0xad5b343a26574634 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657462d expref: 19 pid: 22670 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.151111:0:22664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab777de7000/0xad5b343a26574634 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a2657462d expref: 19 pid: 22670 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.151122:0:22664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.151129:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788839970.151143:0:22664:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005635330s 00010000:00010000:3.0:1788839970.151147:0:22664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.151154:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.151161:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.151167:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.151173:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839970.151177:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.151183:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.151195:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839970.151203:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839970.151842:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab741465600/0xad5b343a265746f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265746f1 expref: 19 pid: 22669 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839970.151866:0:22692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060831616:0@lo:104: 00010000:00010000:0.0:1788839970.151879:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de7000/0xad5b343a26574634 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a2657462d expref: 18 pid: 22670 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839970.151888:0:22692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060831744:0@lo:104: 00010000:00010000:0.0:1788839970.151910:0:22692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.151918:0:22692:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.151924:0:22692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839970.151939:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de6600/0xad5b343a26574730 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839970.152385:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:3615:x1875734060831872:12345-0@lo:103:ldlm_bl.0 Request processed in 1433us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.152393:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839970.152428:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3615:1875734060831872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839970.152438:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+16:3616:x1875734060832000:12345-0@lo:103:ldlm_bl.0 Request processed in 1359us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839970.152446:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839970.152625:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060832000:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1788839970.155144:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788839970.155154:0:23435:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788839970.155158:0:23435:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788839970.155376:0:23436:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788839970.155392:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:3.0:1788839970.155928:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788839970.155965:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839970.156218:0:23436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788839970.156242:0:23437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23437:1875734060832128:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788839970.156302:0:23437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839970.156332:0:23437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7431da900 going to sleep for 11 seconds 00000004:00000080:3.0:1788839970.156609:0:23408:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788839970.156617:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788839970.156656:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839970.156955:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060832128 00000100:00100000:1.0:1788839970.156962:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060832128 00000100:00100000:1.0:1788839970.157009:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788839970.157018:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23437:x1875734060832128:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788839970.157091:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23437:x1875734060832128:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 75us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.157097:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839970.157178:0:23437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23437:1875734060832128:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788839970.157205:0:23437:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788839970.157238:0:23437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23437:1875734060832256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788839970.157266:0:23437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839970.157313:0:23437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7431da900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839970.157338:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060832256 00000100:00100000:1.0:1788839970.157342:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060832256 00000100:00100000:1.0:1788839970.157387:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788839970.157394:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23437:x1875734060832256:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788839970.157482:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23437:x1875734060832256:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 88us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839970.157488:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839970.157526:0:23437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23437:1875734060832256:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788839970.157573:0:23437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23437:1875734060832384:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788839970.157598:0:23437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839970.157633:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060832384 00000100:00100000:2.0:1788839970.157637:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060832384 00000100:00100000:2.0:1788839970.157661:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839970.157666:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23437:x1875734060832384:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788839970.157694:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23437:x1875734060832384:12345-0@lo:900:lod0001_rec0000.0 Request processed in 28us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.157700:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839970.157716:0:23437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7431daf00 going to sleep for 11 seconds 00010000:00080000:2.0:1788839970.157729:0:23437:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab7819f8a80 x1875734060832384/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788839986 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839970.157740:0:23437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23437:1875734060832384:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788839970.157787:0:23437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23437:1875734060832512:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788839970.157808:0:23437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839970.157824:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060832512 00000100:00100000:2.0:1788839970.157827:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060832512 00000100:00100000:2.0:1788839970.157843:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788839970.157848:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23437:x1875734060832512:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788839970.157905:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23437:x1875734060832512:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 56us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839970.157919:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788839970.157934:0:23437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7431da900 going to sleep for 11 seconds 00000100:00100000:2.0:1788839970.157945:0:23437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23437:1875734060832512:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788839970.157975:0:23437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839970.158107:0:23408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788839970.159150:0:23408:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788839970.159214:0:23408:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788839970.159342:0:23408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788839970.159749:0:23408:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1788839970.161270:0:23408:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000040:00080000:2.0:1788839970.164259:0:23437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788839970.164404:0:23437:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788839970.164743:0:23436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788839970.164811:0:23436:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788839970.164817:0:23436:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1788839970.166636:0:23408:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788839970.166660:0:23408:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb69881bcb988 00100000:10000000:3.0:1788839970.166667:0:23408:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788839970.168569:0:23408:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788839970.168599:0:23408:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788839970.168620:0:23408:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788839970.168636:0:23408:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788839970.174076:0:23408:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839970.174301:0:23408:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788839970.370487:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788839971.073072:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788839971.199637:0:23431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788839971.395870:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 10000000:01000000:0.0:1788839971.906959:0:22674:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788839971.906978:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab7467ba000 from 12 10000000:01000000:0.0:1788839971.906984:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788839971.907028:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839971.907041:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839971.907051:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839971.907077:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060832640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839971.907142:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839971.907188:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467686c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839971.907343:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060832640 00000100:00100000:1.0:1788839971.907351:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060832640 00000100:00100000:1.0:1788839971.907409:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788839971.907419:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+16:22674:x1875734060832640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839971.907445:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839971.907461:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab741465600/0xad5b343a2657473e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574737 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839971.907485:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab741465600/0xad5b343a2657473e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574737 expref: 17 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839971.907495:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab741465600/0xad5b343a2657473e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574737 expref: 17 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839971.907504:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab741465600, rc 0) 00000100:00100000:1.0:1788839971.907548:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:22674:x1875734060832640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839971.907555:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788839971.907601:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060832640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839971.907616:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839971.907624:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839971.907684:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060832768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788839971.907716:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839971.907730:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742f0df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839971.907742:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060832768 00000100:00100000:1.0:1788839971.907746:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060832768 00000100:00100000:1.0:1788839971.907790:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788839971.907797:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:22674:x1875734060832768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788839971.907817:0:22672:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788839971.907832:0:22672:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788839971.907835:0:22672:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788839971.907926:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:22674:x1875734060832768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839971.907934:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788839971.908086:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060832768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788839971.908134:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839971.908141:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839971.908148:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839971.908156:0:22674:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788839971.908158:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab781e72000 from 12 10000000:01000000:1.0:1788839971.908161:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788839971.908178:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839971.908185:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839971.908193:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839971.908206:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060832896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839971.908232:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839971.908368:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742f0df00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839971.909065:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060832896 00000100:00100000:0.0:1788839971.909080:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060832896 00000100:00100000:0.0:1788839971.909155:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788839971.909163:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:22674:x1875734060832896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839971.909175:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839971.909187:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab781e68600/0xad5b343a2657474c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574745 expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839971.909206:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab781e68600/0xad5b343a2657474c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574745 expref: 18 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839971.909216:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab781e68600/0xad5b343a2657474c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574745 expref: 18 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839971.909223:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e68600, rc 0) 00000100:00100000:0.0:1788839971.909319:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:22674:x1875734060832896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839971.909325:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788839971.910881:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060832896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839971.910908:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839971.910920:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839971.911102:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060833024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788839971.911156:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839971.911237:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7431da900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839971.914680:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060833024 00000100:00100000:0.0:1788839971.914693:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060833024 00000100:00100000:0.0:1788839971.914759:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788839971.914782:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f0e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:22674:x1875734060833024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788839971.914810:0:22672:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788839971.914831:0:22672:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788839971.914835:0:22672:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788839971.915040:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f0e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:22674:x1875734060833024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 273us (3883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839971.915049:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788839971.915110:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060833024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788839971.915187:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788839971.915197:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839971.915209:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839972.098500:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788839972.223465:0:23431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788839972.433063:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788839973.119859:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839973.438923:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00010000:00010000:1.0:1788839974.145683:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788839974.210323:0:23679:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788839974.464906:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 0 seconds 00010000:00010000:0.0:1788839975.168251:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788839975.170682:0:23732:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839975.171193:0:23732:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788839975.296578:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839975.296597:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060833152:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788839975.296644:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788839975.296651:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788839975.296654:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab78193a000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839975.296664:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ab78193a000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839975.296671:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839975.296688:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819fad80 x1875734060833408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839975.296708:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839975.296712:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788839975.296714:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1788839975.296717:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060833280:0@lo:400:kworker.0 00000100:00080000:2.0:1788839975.296718:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788839975.296740:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839975.296744:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788839975.296748:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839975.296752:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788839975.296757:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839975.296830:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060833408:0@lo:38:kworker.0 00000100:00100000:1.0:1788839975.296835:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839975.296842:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060833536:0@lo:400:kworker.0 00000100:00100000:2.0:1788839975.296876:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839975.296882:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839975.296925:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060833152 00000100:00100000:1.0:1788839975.296932:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060833152 00000100:00100000:2.0:1788839975.296938:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060833408 00000100:00100000:2.0:1788839975.296944:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060833408 00000100:00100000:3.0:1788839975.297009:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839975.297019:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060833664:0@lo:400:kworker.0 00000100:00100000:3.0:1788839975.297055:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839975.297168:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788839975.297175:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060833408:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788839975.297214:0:22682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 630 last 0 00000020:00000080:2.0:1788839975.297257:0:22682:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26574753 00000004:00100000:2.0:1788839975.297272:0:22682:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788839975.297290:0:22682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1788839975.297375:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060833536 00000100:00100000:2.0:1788839975.297379:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060833536 00000100:00100000:2.0:1788839975.297420:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060833664 00000100:00100000:2.0:1788839975.297424:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060833664 00000100:00100000:2.0:1788839975.297447:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839975.297455:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060833536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839975.297511:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060833536:12345-0@lo:400:kworker.0 Request processed in 56us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839975.297518:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839975.297533:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839975.297539:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060833664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839975.297566:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060833664:12345-0@lo:400:kworker.0 Request processed in 28us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839975.297571:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788839975.298034:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab744354e00 x1875734060833664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839975.298049:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060833664:0@lo:400:kworker.0 00000100:00100000:2.0:1788839975.298157:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060833280 00000100:00100000:2.0:1788839975.298163:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060833280 00000100:00100000:2.0:1788839975.298205:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788839975.298213:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f0e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:3614:x1875734060833280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839975.298251:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f0e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:3614:x1875734060833280:12345-0@lo:400:kworker.0 Request processed in 40us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839975.298258:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788839975.299559:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788839975.299578:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060833152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839975.299615:0:22681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788839975.299689:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060833152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839975.299696:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788839975.299752:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7819f8a80 x1875734060833536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839975.299766:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060833536:0@lo:400:kworker.0 00000100:00100000:1.0:1788839975.299895:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060833280:0@lo:400:kworker.0 00000100:00100000:2.0:1788839975.304096:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060833152:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788839975.309129:0:22682:0:(import.c:65:import_set_state_nolock()) ffff8ab777b8d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839975.309249:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1875734060833408:12345-0@lo:38:kworker.0 Request processed in 12070us (12371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839975.309259:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788839975.309331:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788839975.309341:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788839975.309347:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788839975.309349:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788839975.309363:0:3613:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000cdecca93): req@ffff8ab7819fa300 x1875734060826240/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839975.309383:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060833408:0@lo:38:kworker.0 00000100:00100000:0.0:1788839975.309451:0:22718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839975.309475:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7429946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839975.309503:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060826240 00000100:00100000:0.0:1788839975.309508:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060826240 00000100:00100000:0.0:1788839975.309543:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839975.309553:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22718:x1875734060826240:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788839975.309649:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22718:x1875734060826240:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 97us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839975.309657:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839975.309686:0:22718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22718:1875734060826240:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788839975.309716:0:22718:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788839975.309753:0:22718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22718:1875734060833792:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788839975.309804:0:22718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839975.309841:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839975.309853:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060833792 00000100:00100000:0.0:1788839975.309856:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060833792 00000100:00100000:0.0:1788839975.309876:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839975.309882:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22718:x1875734060833792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788839975.309967:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22718:x1875734060833792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 84us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839975.309974:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839975.310000:0:22718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22718:1875734060833792:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788839975.310065:0:22718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22718:1875734060834048:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788839975.310073:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839975.310085:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060833920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839975.310094:0:22718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839975.310114:0:22718:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839975.310125:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839975.310132:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060834048 00000100:00100000:0.0:1788839975.310137:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060834048 00000100:00100000:0.0:1788839975.310160:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060833920 00000100:00100000:0.0:1788839975.310163:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060833920 00000100:00100000:0.0:1788839975.310174:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788839975.310178:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22718:x1875734060834048:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788839975.310243:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22718:x1875734060834048:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839975.310249:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788839975.310261:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788839975.310266:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060833920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839975.310283:0:23417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788839975.310315:0:22718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22718:1875734060834048:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788839975.310353:0:22718:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839975.311249:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060833920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 980us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839975.311257:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839975.311635:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060833920:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788839975.318171:0:22718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788839975.318268:0:22718:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1788839975.318274:0:22718:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:2.0:1788839976.059663:0:23782:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839976.060573:0:23782:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788839976.196626:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788839977.070085:0:23830:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdfc327d50 20000000:00000080:1.0:1788839977.070101:0:23830:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab7812f9c00 uarg=0000000000000000 20000000:01000000:1.0:1788839977.070148:0:23830:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788839977.070155:0:23830:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788839977.070160:0:23830:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788839977.071133:0:23831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788839977.071306:0:23830:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788839977.080061:0:23830:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788839977.080094:0:23830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839977.081140:0:23830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265745fc expref: 17 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839977.081150:0:23830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab741464800/0xad5b343a26574706 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265746ff expref: 17 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839977.081157:0:23830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839977.081204:0:23830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab741464800/0xad5b343a26574706 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265746ff expref: 17 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839977.081218:0:23830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab741464800/0xad5b343a26574706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265746ff expref: 17 pid: 22672 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839977.081233:0:23830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23830:1875734060834176:0@lo:104: 00000100:00100000:1.0:1788839977.081297:0:23830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839977.081349:0:23830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265745fc expref: 17 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839977.081358:0:23830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574603 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265745fc expref: 17 pid: 22672 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839977.081366:0:23830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23830:1875734060834304:0@lo:104: 00000100:00100000:1.0:1788839977.081402:0:23830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839977.081431:0:23830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7431da480 going to sleep for 11 seconds 00000100:00100000:2.0:1788839977.081638:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060834176 00000100:00100000:2.0:1788839977.081646:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060834176 00000100:00100000:2.0:1788839977.081684:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060834304 00000100:00100000:2.0:1788839977.081687:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060834304 00000100:00100000:2.0:1788839977.081704:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839977.081712:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+4:23830:x1875734060834176:12345-0@lo:104: 00010000:00010000:2.0:1788839977.081725:0:22660:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.081825:0:22660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839977.081832:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+4:23830:x1875734060834176:12345-0@lo:104: Request processed in 121us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839977.081839:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839977.081855:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839977.081861:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:23830:x1875734060834304:12345-0@lo:104: 00010000:00010000:2.0:1788839977.081876:0:22660:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.081910:0:22660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788839977.081916:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:23830:x1875734060834304:12345-0@lo:104: Request processed in 56us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839977.081922:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788839977.081946:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839977.081951:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.081958:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741464600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839977.081963:0:22665:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.081972:0:22665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839977.081979:0:22665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839977.081986:0:22665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788839977.082010:0:22665:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082017:0:22665:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839977.082037:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082044:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab741464600/0xad5b343a265746ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574706 expref: -99 pid: 23408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082058:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839977.082062:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082067:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69a00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839977.082070:0:22665:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082083:0:22665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839977.082089:0:22665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839977.082094:0:22665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788839977.082107:0:22665:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082114:0:22665:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839977.082120:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082126:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab781e69a00/0xad5b343a265745fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574603 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082139:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839977.082141:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839977.082142:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839977.082155:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060834432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839977.082184:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839977.082206:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839977.082212:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060834560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839977.082229:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839977.082261:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060834432 00000100:00100000:2.0:1788839977.082265:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060834432 00010000:00010000:2.0:1788839977.082282:0:22664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab741464800/0xad5b343a26574706 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265746ff expref: 18 pid: 22672 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839977.082311:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060834560 00000100:00100000:2.0:1788839977.082314:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060834560 00010000:00010000:2.0:1788839977.082326:0:22664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574603 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265745fc expref: 19 pid: 22672 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839977.082341:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839977.082346:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:3614:x1875734060834432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839977.082357:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839977.082361:0:22664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab741464800/0xad5b343a26574706 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265746ff expref: 19 pid: 22672 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082370:0:22664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab741464800/0xad5b343a26574706 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265746ff expref: 19 pid: 22672 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082384:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839977.082412:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:3614:x1875734060834432:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839977.082417:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839977.082428:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839977.082434:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:3614:x1875734060834560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839977.082440:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839977.082444:0:22664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574603 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265745fc expref: 18 pid: 22672 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082452:0:22664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574603 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265745fc expref: 18 pid: 22672 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082463:0:22664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082476:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082502:0:22664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082509:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082516:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082522:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082533:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4f400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839977.082537:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082544:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082552:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839977.082560:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839977.082580:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:3614:x1875734060834560:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839977.082586:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839977.082622:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060834560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839977.082639:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060834432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839977.083139:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839977.083241:0:23830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab741464800/0xad5b343a26574706 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265746ff expref: 17 pid: 22672 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839977.083253:0:23830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23830:1875734060834176:0@lo:104: 00010000:00010000:1.0:1788839977.083263:0:23830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574603 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265745fc expref: 16 pid: 22672 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839977.083272:0:23830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23830:1875734060834304:0@lo:104: 00010000:00010000:1.0:1788839977.083287:0:23830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839977.083295:0:23830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839977.083301:0:23830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839977.083307:0:23830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab746e4f400/0xad5b343a2657475a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839977.222900:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839978.240498:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788839978.943907:0:22674:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839978.943914:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab7467ba000 from 13 10000000:01000000:0.0:1788839978.943919:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839978.943973:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839978.943985:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839978.943996:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839978.944022:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060834688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839978.944090:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839978.944152:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7463bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839978.944744:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060834688 00000100:00100000:2.0:1788839978.944753:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060834688 00000100:00100000:2.0:1788839978.944838:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788839978.944849:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+16:22674:x1875734060834688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839978.944866:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839978.944883:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de6a00/0xad5b343a26574768 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574761 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839978.944910:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6a00/0xad5b343a26574768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574761 expref: 17 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839978.944923:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de6a00/0xad5b343a26574768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574761 expref: 17 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839978.944933:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6a00, rc 0) 00000100:00100000:2.0:1788839978.945004:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:22674:x1875734060834688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839978.945012:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788839978.945145:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060834688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839978.945161:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839978.945182:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839978.945261:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060834816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839978.945293:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839978.945324:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7463bb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839978.945378:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060834816 00000100:00100000:3.0:1788839978.945384:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060834816 00000100:00100000:3.0:1788839978.945464:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788839978.945474:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:22674:x1875734060834816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839978.945645:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:22674:x1875734060834816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839978.945652:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788839978.945717:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060834816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839978.945754:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060834944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839978.945827:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839978.947683:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab747bdb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788839978.949179:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060834944 00000100:00100000:0.0:1788839978.949193:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060834944 00000100:00100000:0.0:1788839978.949728:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839978.949746:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:22674:x1875734060834944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839978.949951:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:22674:x1875734060834944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (4122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839978.949958:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788839978.951945:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060834944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788839978.952673:0:23921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788839978.955042:0:22674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788839978.955081:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839978.955093:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839978.955106:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839978.955116:0:22674:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788839978.955119:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab781e72000 from 13 10000000:01000000:2.0:1788839978.955121:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788839978.955160:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839978.955169:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839978.955179:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839978.955204:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060835072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839978.955274:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839978.955315:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab747bdb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839978.955336:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060835072 00000100:00100000:2.0:1788839978.955344:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060835072 00000100:00100000:2.0:1788839978.955386:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788839978.955395:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+17:22674:x1875734060835072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839978.955407:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839978.955421:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de7800/0xad5b343a26574776 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657476f expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839978.955454:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de7800/0xad5b343a26574776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657476f expref: 18 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839978.955464:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de7800/0xad5b343a26574776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657476f expref: 18 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839978.955474:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7800, rc 0) 00000100:00100000:2.0:1788839978.955511:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:22674:x1875734060835072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839978.955518:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788839978.955567:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060835072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839978.955582:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839978.955590:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839978.955640:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060835200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839978.955663:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839978.955676:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab747bdb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839978.955761:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060835200 00000100:00100000:2.0:1788839978.955766:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060835200 00000100:00100000:2.0:1788839978.955886:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788839978.955893:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:22674:x1875734060835200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839978.956005:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:22674:x1875734060835200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839978.956024:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788839978.956058:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060835200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839978.956086:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060835328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839978.956125:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839978.956139:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab747bdb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839978.956150:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060835328 00000100:00100000:2.0:1788839978.956153:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060835328 00000100:00100000:2.0:1788839978.956172:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788839978.956178:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:22674:x1875734060835328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839978.956249:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:22674:x1875734060835328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839978.956256:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788839978.956293:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060835328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788839978.959573:0:23922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788839978.959653:0:22674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788839978.960402:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788839978.960419:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839978.960433:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839979.264958:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839979.585493:0:22712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788839980.294035:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788839980.415377:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839980.415385:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839980.415388:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839980.415391:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839980.415404:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839980.415407:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839980.415409:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839980.415411:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839980.415457:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060835456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839980.415576:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839980.415621:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060835968:0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.415644:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839980.415682:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788839980.415688:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060835584:0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.415716:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839980.415738:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060836096:0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.415762:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839980.415832:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060835712:0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.415855:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839980.415872:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839980.415876:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060835840:0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.415896:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839980.416059:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060835456 00000100:00100000:3.0:1788839980.416067:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060835456 00000100:00100000:3.0:1788839980.416106:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060835968 00000100:00100000:3.0:1788839980.416109:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060835968 00000100:00100000:3.0:1788839980.416120:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060835712 00000100:00100000:3.0:1788839980.416121:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060835712 00000100:00100000:3.0:1788839980.416134:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839980.416143:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3616:x1875734060835456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839980.416189:0:23417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788839980.416236:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3616:x1875734060835456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839980.416243:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839980.416259:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839980.416265:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060835968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.416294:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060835968:12345-0@lo:400:kworker.0 Request processed in 30us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839980.416300:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839980.416320:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839980.416327:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060835712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.416359:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060835712:12345-0@lo:400:kworker.0 Request processed in 33us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839980.416366:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839980.416385:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060835584 00000100:00100000:3.0:1788839980.416389:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060835584 00000100:00100000:3.0:1788839980.416413:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788839980.416419:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:3616:x1875734060835584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.416446:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:3616:x1875734060835584:12345-0@lo:400:kworker.0 Request processed in 27us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839980.416451:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788839980.416475:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060836096 00000100:00100000:3.0:1788839980.416478:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060836096 00000100:00100000:3.0:1788839980.416499:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060835840 00000100:00100000:3.0:1788839980.416502:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060835840 00000100:00100000:3.0:1788839980.416518:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839980.416523:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060836096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.416550:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060836096:12345-0@lo:400:kworker.0 Request processed in 27us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839980.416555:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839980.416565:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839980.416570:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060835840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.416592:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060835840:12345-0@lo:400:kworker.0 Request processed in 22us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839980.416597:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788839980.416645:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7443da300 x1875734060835840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839980.416667:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060835840:0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.416680:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060835712:0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.416708:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060835584:0@lo:400:kworker.0 00010000:00080000:3.0:1788839980.416717:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7443dad80 x1875734060836096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839996 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839980.416726:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060836096:0@lo:400:kworker.0 00000100:00100000:3.0:1788839980.416739:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060835456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839980.416748:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060835968:0@lo:400:kworker.0 00000100:00100000:1.0:1788839980.417159:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839980.417170:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060836224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839980.417216:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839980.417360:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060836224 00000100:00100000:3.0:1788839980.417366:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060836224 00000100:00100000:3.0:1788839980.417403:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839980.417410:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060836224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839980.417432:0:23417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788839980.417476:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060836224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839980.417483:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788839980.420366:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060836224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839980.420490:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839970/real 1788839970] req@ffff8ab7819f9500 x1875734060829568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839980 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839980.420510:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab7819f9500 x1875734060829568/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839980 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839980.420528:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839970/real 1788839970] req@ffff8ab646b4dc00 x1875734060829440/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839980 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839980.420539:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab646b4dc00 x1875734060829440/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839980 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788839980.420552:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839980.420582:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788839980.420585:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060829568:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788839980.420589:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab744349000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839980.420594:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788839980.420597:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060829440:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788839980.420623:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839980.420628:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839980.420631:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839980.420634:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839980.420637:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839980.420639:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788839980.420642:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab744349000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839980.420646:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 625 00000100:00080000:0.0:1788839980.420650:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839980.420655:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ab744349000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839980.420682:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6476b0e00 x1875734060836352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839980.420704:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839980.420707:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788839980.420708:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839980.420711:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 625 00000100:00080000:0.0:1788839980.420713:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839980.420716:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ab6479d5800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839980.420729:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6476b2d80 x1875734060836480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839980.420756:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060836352:0@lo:8:kworker.0 00000400:00000100:0.0:1788839980.421295:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060836352 offset 0 length 520: 4 00000100:00100000:0.0:1788839980.421328:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060836480:0@lo:8:kworker.0 00000400:00000100:0.0:1788839980.421340:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060836480 offset 0 length 520: 4 00000001:00100000:3.0:1788839980.939660:0:23409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788839981.310889:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839981.440308:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839966/real 1788839966] req@ffff8ab7819f9c00 x1875734060827264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839981 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839981.440339:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab7819f9c00 x1875734060827264/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839981 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839981.440350:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839966/real 1788839966] req@ffff8ab7819f8000 x1875734060827392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839981 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839981.440360:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab7819f8000 x1875734060827392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839981 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839981.440379:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839981.440413:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788839981.440424:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060827264:0@lo:8:kworker.0 00000100:00080000:2.0:1788839981.440429:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839981.440437:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788839981.440440:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060827392:0@lo:8:kworker.0 00000100:00080000:3.0:1788839981.440661:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839981.440666:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788839981.440669:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab78193b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839981.440674:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 621 00000100:00080000:3.0:1788839981.440684:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788839981.440690:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab78193b800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839981.440710:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7443db800 x1875734060836864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839981.440724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839981.440727:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788839981.440729:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab78193d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839981.440732:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 621 00000100:00080000:3.0:1788839981.440734:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788839981.440737:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab78193d800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839981.440747:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7443d8a80 x1875734060836992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839981.440801:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839981.440805:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839981.440808:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839981.440810:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839981.440839:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060836736:0@lo:400:kworker.0 00000100:00100000:3.0:1788839981.440905:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839981.440937:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839981.440943:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060837120:0@lo:400:kworker.0 00000100:00100000:3.0:1788839981.440969:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839981.441002:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060836736 00000100:00100000:3.0:1788839981.441010:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060836736 00000100:00100000:3.0:1788839981.441056:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839981.441064:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060836736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839981.441083:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3615:1875734060836608:0@lo:400:kworker.0 00000100:00100000:1.0:1788839981.441115:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839981.441120:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060836736:12345-0@lo:400:kworker.0 Request processed in 56us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839981.441127:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839981.441148:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060837120 00000100:00100000:1.0:1788839981.441149:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060837376:0@lo:400:kworker.0 00000100:00100000:3.0:1788839981.441152:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060837120 00000100:00100000:1.0:1788839981.441171:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839981.441283:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060837248:0@lo:400:kworker.0 00000100:00100000:2.0:1788839981.441312:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839981.441341:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060837248 00000100:00100000:2.0:1788839981.441344:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060837248 00000100:00100000:2.0:1788839981.441368:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788839981.441374:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060837248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839981.441408:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060837248:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839981.441414:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788839981.441445:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060837248:0@lo:400:kworker.0 00000100:00100000:3.0:1788839981.446583:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060837376 00000100:00100000:3.0:1788839981.446599:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060837376 00000100:00100000:3.0:1788839981.446661:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839981.446672:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060837120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839981.446762:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060837120:12345-0@lo:400:kworker.0 Request processed in 92us (5792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839981.446794:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839981.446814:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839981.446821:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060837376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839981.446863:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060837376:12345-0@lo:400:kworker.0 Request processed in 43us (5690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839981.446869:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839981.447404:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060836608 00000100:00100000:0.0:1788839981.447411:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060836608 00000100:00100000:0.0:1788839981.447440:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788839981.447446:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:3615:x1875734060836608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839981.447484:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:3615:x1875734060836608:12345-0@lo:400:kworker.0 Request processed in 38us (6368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839981.447490:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1788839981.447552:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7443da300 x1875734060837120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839981.447570:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060837120:0@lo:400:kworker.0 00000100:00100000:0.0:1788839981.447584:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060836736:0@lo:400:kworker.0 00000100:00100000:0.0:1788839981.447636:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060836864:0@lo:8:kworker.0 00000400:00000100:0.0:1788839981.447662:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060836864 offset 0 length 520: 4 00000100:00100000:0.0:1788839981.447689:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060836992:0@lo:8:kworker.0 00000400:00000100:0.0:1788839981.447704:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060836992 offset 0 length 520: 4 00000100:00100000:0.0:1788839981.447764:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3615:1875734060836608:0@lo:400:kworker.0 00010000:00080000:0.0:1788839981.447848:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7443da680 x1875734060837376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839997 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839981.447858:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060837376:0@lo:400:kworker.0 00010000:00010000:0.0:1788839982.335103:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839982.463733:0:23431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839983.359963:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788839983.398026:0:24179:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788839983.398031:0:24179:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788839983.398033:0:24179:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788839983.399242:0:24179:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab777c24000 00000020:01000004:3.0:1788839983.399263:0:24179:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788839983.399279:0:24179:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788839983.399312:0:24179:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ab746fd8000) 00000020:00000080:3.0:1788839983.399332:0:24179:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788839983.485816:0:24179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788839983.493556:0:24179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788839983.494110:0:24179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788839983.494429:0:24179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788839983.494743:0:24179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788839983.495274:0:24179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788839983.495464:0:24179:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788839983.498823:0:24179:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788839983.499070:0:24179:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788839983.499086:0:24179:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788839983.499101:0:24179:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xad5b343a26574784 00000020:01000004:2.0:1788839983.499109:0:24179:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788839983.500871:0:24179:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788839983.500882:0:24179:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788839983.500895:0:24179:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788839983.500905:0:24179:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788839983.500926:0:24179:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ab7487d3370) 00000020:00000080:2.0:1788839983.500948:0:24179:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788839983.502318:0:24179:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839983.502531:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788839983.502537:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788839983.511752:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788839983.511790:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788839983.512839:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788839983.512848:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788839983.516218:0:24179:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839983.516476:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788839983.516484:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788839983.521550:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788839983.521565:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788839983.543555:0:24179:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839983.543911:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788839983.543918:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788839983.547542:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788839983.547558:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788839983.548867:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788839983.548879:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788839983.556493:0:24179:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788839983.556758:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788839983.557204:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788839983.563963:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788839983.563989:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788839983.613395:0:24179:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839983.613744:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788839983.613752:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788839983.615095:0:24179:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788839983.615104:0:24179:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788839983.615548:0:24179:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788839983.615576:0:24179:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788839983.615582:0:24179:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788839983.639486:0:24179:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788839983.639534:0:24179:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788839983.639539:0:24179:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788839983.639540:0:24179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788839983.639542:0:24179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839983.639543:0:24179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839983.639544:0:24179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839983.639546:0:24179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839983.639547:0:24179:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839983.639549:0:24179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839983.639551:0:24179:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788839983.639555:0:24179:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788839983.639557:0:24179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788839983.639558:0:24179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788839983.639559:0:24179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839983.639560:0:24179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839983.639561:0:24179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839983.639563:0:24179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839983.639564:0:24179:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839983.639565:0:24179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839983.639566:0:24179:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788839983.639594:0:24179:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788839983.639616:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060837504:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788839983.639711:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.639810:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7450cc240 going to sleep for 11 seconds 00000100:00100000:3.0:1788839983.639820:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060837504 00000100:00100000:3.0:1788839983.639829:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060837504 00000100:00100000:3.0:1788839983.639875:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788839983.639884:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:24179:x1875734060837504:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788839983.639916:0:22670:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788839983.639921:0:22670:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788839983.639937:0:22670:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788839983.642309:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:24179:x1875734060837504:12345-0@lo:253:mount.lustre.0 Request processed in 2417us (2589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.642326:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788839983.642337:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060837504:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788839983.642355:0:24179:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788839983.642358:0:24179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788839983.642373:0:24179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788839983.642375:0:24179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839983.642376:0:24179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839983.642377:0:24179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839983.642378:0:24179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839983.642380:0:24179:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839983.642382:0:24179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839983.642383:0:24179:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788839983.642408:0:24179:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab777c24000 from lustre-OST0000 10000000:01000000:1.0:1788839983.642437:0:24179:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788839983.642440:0:24179:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788839983.642449:0:24179:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab6419419b8 local copy 00010000:00010000:1.0:1788839983.642461:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839983.642576:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060837632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839983.642610:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.642658:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7412edd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839983.642874:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060837632 00000100:00100000:3.0:1788839983.642881:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060837632 00000100:00100000:3.0:1788839983.643197:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788839983.643208:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:24179:x1875734060837632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839983.643294:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:24179:x1875734060837632:12345-0@lo:501:mount.lustre.0 Request processed in 89us (683us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788839983.643301:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788839983.643368:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060837632:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788839983.643384:0:24179:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788839983.643402:0:24179:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788839983.643409:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839983.643418:0:24179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839983.643444:0:24179:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab777c24000 10000000:01000000:1.0:1788839983.643449:0:24179:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788839983.643455:0:24179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788839983.643457:0:24179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839983.643470:0:24179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788839983.643474:0:24179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788839983.643501:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ea00/0xad5b343a26574792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839983.643509:0:24179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ea00/0xad5b343a26574792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839983.643519:0:24179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ea00/0xad5b343a26574792 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839983.643535:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060837760:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788839983.643561:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.644213:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7412edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839983.644387:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060837760 00000100:00100000:0.0:1788839983.644395:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060837760 00000100:00100000:0.0:1788839983.644429:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788839983.644436:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+18:24179:x1875734060837760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839983.644449:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839983.644463:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab781e68400/0xad5b343a26574799 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574792 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839983.644488:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab781e68400/0xad5b343a26574799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574792 expref: 19 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839983.644512:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab781e68400/0xad5b343a26574799 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574792 expref: 19 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839983.644521:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e68400, rc 0) 00000100:00100000:0.0:1788839983.644565:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:24179:x1875734060837760:12345-0@lo:101:mount.lustre.0 Request processed in 129us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839983.644572:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788839983.644678:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060837760:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839983.644691:0:24179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ea00/0xad5b343a26574792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574799 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839983.644701:0:24179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ea00/0xad5b343a26574792 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574799 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839983.652353:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1788839983.653192:0:24179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839983.656028:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788839983.656080:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788839983.656114:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788839983.656130:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788839983.656143:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788839983.656156:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788839983.656169:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788839983.656194:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788839983.656411:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788839983.656424:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788839983.656438:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788839983.656451:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788839983.656476:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788839983.656481:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788839983.656582:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060837888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839983.656730:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.657017:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7450cc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788839983.657078:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060837888 00000100:00100000:0.0:1788839983.657086:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060837888 00000100:00100000:0.0:1788839983.657176:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788839983.657187:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:24179:x1875734060837888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839983.657358:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:24179:x1875734060837888:12345-0@lo:501:mount.lustre.0 Request processed in 172us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839983.657365:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788839983.657429:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060837888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839983.657465:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838016:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839983.657506:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.657662:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7450cc240 going to sleep for 11 seconds 00000100:00100000:3.0:1788839983.657844:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060838016 00000100:00100000:3.0:1788839983.657850:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060838016 00000100:00100000:3.0:1788839983.657874:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788839983.657880:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:24179:x1875734060838016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839983.658517:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:24179:x1875734060838016:12345-0@lo:503:mount.lustre.0 Request processed in 635us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.658525:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788839983.658613:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838016:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788839983.659046:0:24179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839983.659115:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838144:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839983.659159:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.659186:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839983.659419:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060838144 00000100:00100000:3.0:1788839983.659424:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060838144 00000100:00100000:3.0:1788839983.659455:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788839983.659463:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:24179:x1875734060838144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839983.659951:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:24179:x1875734060838144:12345-0@lo:502:mount.lustre.0 Request processed in 488us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.659958:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788839983.660069:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838144:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839983.660312:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788839983.660337:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788839983.660350:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788839983.660377:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788839983.660393:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788839983.660405:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788839983.660417:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788839983.660437:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788839983.660449:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788839983.660463:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788839983.660476:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788839983.660487:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788839983.660512:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839983.660551:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.660626:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7412edd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839983.660690:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060838272 00000100:00100000:2.0:1788839983.660696:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060838272 00000100:00100000:3.0:1788839983.660732:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788839983.660742:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:24179:x1875734060838272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839983.663120:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:24179:x1875734060838272:12345-0@lo:502:mount.lustre.0 Request processed in 2369us (2556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.663136:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788839983.663416:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788839983.663526:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1788839983.663540:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788839983.664977:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788839983.664987:0:24196:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788839983.664994:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839983.664996:0:24196:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788839983.665002:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839983.665031:0:24196:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ab647adcd28) 00000020:00000080:1.0:1788839983.665059:0:24196:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788839983.665067:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788839983.665152:0:24196:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab777c24000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788839983.665160:0:24196:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788839983.665167:0:24196:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xad5b343a265747a7 00010000:00010000:0.0:1788839983.690018:0:24196:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788839983.691382:0:24196:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1788839983.694591:0:24196:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788839983.697414:0:24196:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788839983.697429:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839983.697437:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839983.697445:0:24196:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788839983.697450:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788839983.697453:0:24196:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1788839983.697455:0:24196:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788839983.697456:0:24196:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788839983.697458:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788839983.697460:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839983.697462:0:24196:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788839983.697464:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839983.697468:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839983.697469:0:24196:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788839983.697472:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788839983.697474:0:24196:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788839983.697477:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839983.697479:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839983.697480:0:24196:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788839983.697483:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839983.697486:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839983.697487:0:24196:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788839983.697490:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788839983.697524:0:24196:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839983.697527:0:24196:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839983.697529:0:24196:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788839983.697532:0:24196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1788839983.703832:0:24179:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788839983.703892:0:24179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788839983.703914:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ea00/0xad5b343a26574792 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574799 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839983.703927:0:24179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ea00/0xad5b343a26574792 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574799 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839983.703935:0:24179:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab777c24000 from 1 10000000:01000000:1.0:1788839983.703937:0:24179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839983.703974:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839983.703994:0:24179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839983.704006:0:24179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839983.704032:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788839983.704102:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.704149:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839983.704288:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060838400 00000100:00100000:3.0:1788839983.704297:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060838400 00000100:00100000:3.0:1788839983.704353:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788839983.704362:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:24179:x1875734060838400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839983.704377:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839983.704393:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552e00/0xad5b343a265747b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265747ae expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.704418:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552e00/0xad5b343a265747b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265747ae expref: 20 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.704430:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552e00/0xad5b343a265747b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265747ae expref: 20 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.704439:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552e00, rc 0) 00000100:00100000:3.0:1788839983.704490:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:24179:x1875734060838400:12345-0@lo:101:mount.lustre.0 Request processed in 129us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.704507:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788839983.704679:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839983.704697:0:24179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839983.704706:0:24179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839983.706192:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788839983.706482:0:24179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839983.706688:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788839983.706714:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788839983.706728:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788839983.706742:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788839983.707322:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788839983.707345:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788839983.707359:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788839983.707372:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788839983.707384:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788839983.707396:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788839983.707409:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788839983.707427:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788839983.707433:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788839983.707510:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839983.707568:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839983.707604:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7463bbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839983.708421:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060838528 00000100:00100000:3.0:1788839983.708430:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060838528 00000100:00100000:3.0:1788839983.708527:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788839983.708538:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:24179:x1875734060838528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839983.708677:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:24179:x1875734060838528:12345-0@lo:501:mount.lustre.0 Request processed in 141us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.708685:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788839983.708763:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839983.708830:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839983.708878:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.721844:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839983.721962:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060838656 00000100:00100000:2.0:1788839983.721974:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060838656 00000100:00100000:2.0:1788839983.722033:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788839983.722043:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:24179:x1875734060838656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839983.722466:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:24179:x1875734060838656:12345-0@lo:503:mount.lustre.0 Request processed in 422us (13585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839983.722476:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788839983.722601:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838656:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788839983.723075:0:24179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839983.723152:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839983.723372:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839983.723447:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060838784 00000100:00100000:2.0:1788839983.723453:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060838784 00000100:00100000:2.0:1788839983.723480:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788839983.723487:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:24179:x1875734060838784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839983.723584:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742f0d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788839983.723857:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:24179:x1875734060838784:12345-0@lo:502:mount.lustre.0 Request processed in 370us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839983.723873:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788839983.723948:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839983.724127:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788839983.724153:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788839983.724166:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788839983.724177:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788839983.724187:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788839983.724391:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788839983.724418:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788839983.724432:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788839983.724443:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788839983.724456:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788839983.724487:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788839983.724518:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839983.724558:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.724594:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7450cc240 going to sleep for 11 seconds 00000100:00100000:3.0:1788839983.724657:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060838912 00000100:00100000:3.0:1788839983.724663:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060838912 00000100:00100000:3.0:1788839983.724735:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788839983.724745:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:24179:x1875734060838912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839983.724880:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:24179:x1875734060838912:12345-0@lo:502:mount.lustre.0 Request processed in 138us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.724888:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788839983.724976:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060838912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839983.725022:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788839983.725032:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788839983.727603:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839983.727621:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839983.727624:0:24200:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788839983.727634:0:24200:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab777c24000 00000020:00000080:1.0:1788839983.727637:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839983.727647:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839983.727650:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839983.727651:0:24200:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788839983.727654:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839983.727657:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839983.727658:0:24200:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788839983.727662:0:24200:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab777c24000 00000020:00000080:1.0:1788839983.727664:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839983.727808:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839983.727812:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839983.727814:0:24200:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788839983.727817:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839983.727820:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839983.727821:0:24200:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839983.727824:0:24200:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab777c24000 00000020:00000080:1.0:1788839983.727841:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839983.728953:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839983.728960:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839983.728962:0:24200:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839983.728965:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839983.728969:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839983.728970:0:24200:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788839983.728974:0:24200:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab777c24000 00000020:00000080:1.0:1788839983.728976:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839983.729015:0:24200:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839983.729019:0:24200:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839983.729020:0:24200:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788839983.729024:0:24200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788839983.733805:0:24179:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788839983.733854:0:24179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839983.733879:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839983.733893:0:24179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839983.733964:0:24179:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788839983.733968:0:24179:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab777c24000 10000000:01000000:2.0:1788839983.733972:0:24179:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab777c24000 10000000:01000000:2.0:1788839983.733976:0:24179:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788839983.733983:0:24179:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab777c24000 from 1 10000000:01000000:2.0:1788839983.733986:0:24179:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839983.734029:0:24179:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265747bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839983.734039:0:24179:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265747bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839983.734052:0:24179:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265747bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839983.734084:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788839983.736399:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839983.736463:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839983.736482:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060839040 00000100:00100000:3.0:1788839983.736491:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060839040 00000100:00100000:3.0:1788839983.736562:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788839983.736572:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:24179:x1875734060839040:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839983.736589:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839983.736609:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552800/0xad5b343a265747c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265747bc expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.736638:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552800/0xad5b343a265747c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265747bc expref: 21 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.736650:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552800/0xad5b343a265747c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265747bc expref: 21 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.736666:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552800, rc 0) 00000100:00100000:3.0:1788839983.736704:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060839040:12345-0@lo:101:mount.lustre.0 Request processed in 135us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.736712:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788839983.736820:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839983.736838:0:24179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265747bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265747c3 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839983.736853:0:24179:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265747bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265747c3 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839983.759493:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788839983.759844:0:24179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839983.760111:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788839983.760137:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788839983.760151:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788839983.760164:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788839983.760176:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788839983.760191:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788839983.760204:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788839983.760235:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788839983.760249:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788839983.760262:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788839983.760286:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788839983.760298:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788839983.760311:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788839983.760324:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788839983.760336:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788839983.760347:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788839983.760360:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788839983.760373:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788839983.760386:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788839983.760398:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788839983.760410:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788839983.760423:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788839983.760436:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788839983.760466:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788839983.760482:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788839983.760496:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788839983.760508:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788839983.760519:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788839983.760531:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788839983.760543:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788839983.760556:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788839983.760570:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788839983.760582:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788839983.760593:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788839983.760607:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788839983.760619:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788839983.760629:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788839983.760640:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788839983.760652:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788839983.760678:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788839983.760694:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788839983.760708:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788839983.760721:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788839983.760744:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788839983.760757:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788839983.760807:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788839983.760823:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788839983.760838:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788839983.760962:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788839983.760984:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788839983.761004:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788839983.761010:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788839983.761100:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839983.761167:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839983.761216:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746355780 going to sleep for 11 seconds 00000100:00100000:2.0:1788839983.761481:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060839168 00000100:00100000:2.0:1788839983.761490:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060839168 00000100:00100000:2.0:1788839983.761550:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788839983.761561:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060839168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839983.761706:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060839168:12345-0@lo:501:mount.lustre.0 Request processed in 147us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839983.761714:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788839983.761914:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839983.761955:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839296:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839983.762001:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.762023:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742f0d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788839983.762093:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060839296 00000100:00100000:2.0:1788839983.762098:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060839296 00000100:00100000:2.0:1788839983.762200:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788839983.762208:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060839296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839983.762294:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060839296:12345-0@lo:503:mount.lustre.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839983.762301:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788839983.762375:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839296:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788839983.762812:0:24179:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839983.762891:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839983.762934:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.762965:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7450cc240 going to sleep for 11 seconds 00000100:00100000:2.0:1788839983.763042:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060839424 00000100:00100000:2.0:1788839983.763048:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060839424 00000100:00100000:2.0:1788839983.763076:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788839983.763082:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060839424:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839983.763249:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060839424:12345-0@lo:502:mount.lustre.0 Request processed in 165us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839983.763256:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788839983.765261:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839983.767349:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788839983.767403:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788839983.767420:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788839983.767435:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788839983.767449:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788839983.767463:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788839983.767476:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788839983.767490:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788839983.767503:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788839983.767516:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788839983.767545:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788839983.767560:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788839983.767572:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788839983.767585:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788839983.767597:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788839983.767610:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788839983.767623:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788839983.767636:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788839983.767648:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788839983.767662:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788839983.767685:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788839983.767698:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788839983.767712:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788839983.767726:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788839983.767741:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788839983.767755:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788839983.767812:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788839983.767828:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788839983.767841:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788839983.767855:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788839983.767869:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788839983.767883:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788839983.767896:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788839983.767911:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788839983.767925:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788839983.767939:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788839983.767953:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788839983.767966:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788839983.767980:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788839983.767994:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788839983.768006:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788839983.768020:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788839983.768049:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788839983.768065:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788839983.768079:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788839983.768093:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788839983.771912:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788839983.771983:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788839983.772044:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839983.772199:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839983.772252:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7463559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839983.772422:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060839552 00000100:00100000:3.0:1788839983.772430:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060839552 00000100:00100000:3.0:1788839983.772489:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788839983.772498:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060839552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839983.772650:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060839552:12345-0@lo:502:mount.lustre.0 Request processed in 152us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.772659:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788839983.774876:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839983.775219:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788839983.775248:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788839983.775291:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839983.775367:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839983.775414:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7463559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839983.777335:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060839680 00000100:00100000:3.0:1788839983.777351:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060839680 00000100:00100000:3.0:1788839983.777423:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788839983.777436:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060839680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839983.777661:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060839680:12345-0@lo:502:mount.lustre.0 Request processed in 227us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.777668:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788839983.777748:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060839680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839983.778239:0:24179:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788839983.778255:0:24179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788839983.780446:0:24206:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788839983.780466:0:24206:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ab647ad8000) 00000020:00000080:1.0:1788839983.780490:0:24206:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788839983.780570:0:24206:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab777c24000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788839983.780575:0:24206:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab777c24000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788839983.780587:0:24206:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab777c24000 3 00010000:00080000:1.0:1788839983.780624:0:24206:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab742bea800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788839983.785523:0:24206:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788839983.789107:0:24206:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788839983.789178:0:24206:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788839983.789204:0:24206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xad5b343a265747d1 00000100:00080000:3.0:1788839983.789219:0:24206:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839983.789227:0:24206:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab742bea800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839983.789282:0:24206:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7443db480 x1875734060839808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839983.789975:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060839808:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788839983.790069:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839983.790156:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060839808 00000100:00100000:3.0:1788839983.790163:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060839808 00000100:00100000:3.0:1788839983.790209:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839983.790217:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875734060839808:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788839983.790256:0:22677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 638 last 0 00000020:00000080:3.0:1788839983.790737:0:22677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xad5b343a265747d8 00000004:00100000:3.0:1788839983.790755:0:22677:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788839983.790885:0:24206:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788839983.790952:0:22677:0:(import.c:65:import_set_state_nolock()) ffff8ab7477ad000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839983.791034:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1875734060839808:12345-0@lo:38:llog_process_th.0 Request processed in 815us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.791044:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788839983.791092:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7443db480 x1875734060839808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839983.791106:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839983.791115:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1788839983.791124:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788839983.791129:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788839983.791132:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab742bea800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788839983.791137:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788839983.791139:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060839808:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788839983.791152:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839983.791155:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839983.791158:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839983.791201:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839983.791205:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839983.791208:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839983.791211:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788839983.791427:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060839936:0@lo:400:kworker.0 00000100:00100000:1.0:1788839983.791466:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.791500:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839983.791507:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060840064:0@lo:400:kworker.0 00000100:00100000:1.0:1788839983.791529:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.791565:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060840064 00000100:00100000:1.0:1788839983.791570:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060840064 00000100:00100000:1.0:1788839983.791654:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788839983.791664:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060840064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839983.791710:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060840064:12345-0@lo:400:kworker.0 Request processed in 48us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839983.791716:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839983.791724:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060840192:0@lo:400:kworker.0 00010000:00080000:1.0:1788839983.791750:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7443db480 x1875734060840064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839983.791807:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060840064:0@lo:400:kworker.0 00000100:00100000:3.0:1788839983.792071:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839983.792098:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839983.792105:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060840320:0@lo:400:kworker.0 00000100:00100000:3.0:1788839983.792131:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839983.792183:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060839936 00000100:00100000:3.0:1788839983.792198:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060839936 00000100:00100000:3.0:1788839983.792241:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060840192 00000100:00100000:3.0:1788839983.792244:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060840192 00000100:00100000:3.0:1788839983.792270:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839983.792278:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060839936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839983.792915:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060839936:12345-0@lo:400:kworker.0 Request processed in 571us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.792926:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839983.792948:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839983.792955:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060840192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839983.793160:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060840192:12345-0@lo:400:kworker.0 Request processed in 205us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.793167:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839983.793219:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060839936:0@lo:400:kworker.0 00000100:00100000:3.0:1788839983.793260:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060840320 00000100:00100000:3.0:1788839983.793265:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060840320 00000100:00100000:3.0:1788839983.793306:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839983.793716:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060840320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839983.793754:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060840320:12345-0@lo:400:kworker.0 Request processed in 441us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.793760:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788839983.794460:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7443db100 x1875734060840320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839983.794474:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060840320:0@lo:400:kworker.0 00000100:00100000:0.0:1788839983.794485:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060840192:0@lo:400:kworker.0 00000020:01000004:2.0:1788839983.796373:0:24206:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788839983.796399:0:24206:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ab7487d19b8) 00000020:00000080:2.0:1788839983.796430:0:24206:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788839983.796519:0:24206:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab777c24000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788839983.796523:0:24206:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab777c24000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788839983.796525:0:24206:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab777c24000 3 00010000:00080000:2.0:1788839983.796555:0:24206:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab77e443000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788839983.799578:0:24206:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788839983.800215:0:24206:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788839983.800269:0:24206:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788839983.800284:0:24206:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xad5b343a265747e6 00000100:00080000:3.0:1788839983.800294:0:24206:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839983.800300:0:24206:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ab77e443000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839983.800340:0:24206:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7443d9f80 x1875734060840448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839983.800372:0:24206:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788839983.800412:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875734060840448:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788839983.800487:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788839983.800658:0:24206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00080000:1.0:1788839983.800667:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839983.800672:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839983.800674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839983.800677:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839983.800681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839983.800683:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839983.800692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839983.800694:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788839983.800716:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060840448 00000100:00100000:1.0:1788839983.800724:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060840448 00000100:00100000:1.0:1788839983.800755:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000020:01000000:0.0:1788839983.800756:0:24179:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00100000:1.0:1788839983.800794:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060840448:12345-0@lo:38:llog_process_th.0 10000000:01000000:0.0:1788839983.800812:0:24179:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00080000:1.0:1788839983.800819:0:22676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 638 last 0 00010000:00010000:0.0:1788839983.800824:0:24179:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265747bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265747c3 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839983.800835:0:24179:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7600/0xad5b343a265747bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265747c3 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788839983.800848:0:22676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xad5b343a265747ed 00000004:00100000:1.0:1788839983.800867:0:22676:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000004:0.0:1788839983.800882:0:24179:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788839983.800884:0:24179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788839983.800885:0:24179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839983.800889:0:24179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839983.800890:0:24179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839983.800891:0:24179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839983.800893:0:24179:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788839983.800894:0:24179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839983.800896:0:24179:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788839983.800899:0:24179:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000100:00080000:1.0:1788839983.800901:0:22676:0:(import.c:65:import_set_state_nolock()) ffff8ab742beb000 : changing import state from RECOVER to FULL 00000020:01000004:0.0:1788839983.800902:0:24179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788839983.800903:0:24179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788839983.800904:0:24179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839983.800905:0:24179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839983.800905:0:24179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839983.800906:0:24179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839983.800907:0:24179:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788839983.800908:0:24179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839983.800909:0:24179:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788839983.800923:0:24179:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788839983.800934:0:24179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060840576:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788839983.800959:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1875734060840448:12345-0@lo:38:llog_process_th.0 Request processed in 165us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839983.800965:0:24179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.800967:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839983.800988:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060840576 00000100:00100000:0.0:1788839983.800992:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060840576 00010000:00080000:1.0:1788839983.801014:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7443d9f80 x1875734060840448/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839983.801018:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788839983.801023:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060840576:12345-0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788839983.801024:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788839983.801033:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788839983.801039:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 20000000:01000000:0.0:1788839983.801041:0:22672:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00080000:1.0:1788839983.801042:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788839983.801044:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab77e443000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788839983.801049:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875734060840448:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788839983.801053:0:22672:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788839983.801212:0:24179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7463559c0 going to sleep for 11 seconds 20000000:01000000:1.0:1788839983.809854:0:22672:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788839983.809875:0:22672:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788839983.809955:0:22692:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788839983.809963:0:22692:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788839983.809992:0:22692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839983.810012:0:22692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab741465600/0xad5b343a2657473e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574737 expref: 21 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839983.810020:0:22692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab781e68600/0xad5b343a2657474c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574745 expref: 21 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839983.810027:0:22692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839983.810085:0:22692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab781e68600/0xad5b343a2657474c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26574745 expref: 21 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839983.810101:0:22692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab781e68600/0xad5b343a2657474c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26574745 expref: 21 pid: 22672 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839983.810118:0:22692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060840704:0@lo:104: 00000100:00100000:2.0:1788839983.810201:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839983.810405:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24179:x1875734060840576:12345-0@lo:253:mount.lustre.0 Request processed in 9379us (9436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839983.810423:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788839983.810433:0:24179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24179:1875734060840576:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788839983.810449:0:24179:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788839983.810453:0:24179:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788839983.810455:0:24179:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788839983.810456:0:24179:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839983.810458:0:24179:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839983.810460:0:24179:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839983.810461:0:24179:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839983.810463:0:24179:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788839983.810471:0:24179:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839983.810473:0:24179:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788839983.810563:0:24179:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788839983.810835:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060840704 00000100:00100000:3.0:1788839983.810842:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060840704 00000100:00100000:3.0:1788839983.810885:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839983.810895:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:22692:x1875734060840704:12345-0@lo:104: 00010000:00010000:3.0:1788839983.810909:0:22661:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.810952:0:22661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839983.810958:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:22692:x1875734060840704:12345-0@lo:104: Request processed in 66us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.810964:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788839983.810981:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839983.810987:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.810994:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741464000 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839983.810998:0:22666:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.811006:0:22666:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839983.811024:0:22666:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839983.811030:0:22666:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839983.811071:0:22666:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.811079:0:22666:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839983.811109:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.811117:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26574745 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657474c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.811130:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839983.811133:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839983.811134:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839983.811148:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060840832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839983.811185:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839983.811380:0:22692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab741465600/0xad5b343a2657473e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26574737 expref: 20 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839983.811392:0:22692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab741465600/0xad5b343a2657473e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26574737 expref: 20 pid: 22669 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839983.811403:0:22692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060840960:0@lo:104: 00000100:00100000:2.0:1788839983.811439:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839983.811463:0:22692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75ff52000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839983.811482:0:22692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060840704:0@lo:104: 00000100:00100000:3.0:1788839983.811615:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060840832 00000100:00100000:3.0:1788839983.811621:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060840832 00010000:00010000:3.0:1788839983.811645:0:22663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab781e68600/0xad5b343a2657474c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26574745 expref: 21 pid: 22672 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839983.811666:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839983.811674:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:3616:x1875734060840832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839983.811686:0:22663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839983.811691:0:22663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab781e68600/0xad5b343a2657474c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26574745 expref: 21 pid: 22672 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.811708:0:22663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab781e68600/0xad5b343a2657474c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26574745 expref: 21 pid: 22672 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.811722:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab781e68600/0xad5b343a2657474c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26574745 expref: 21 pid: 22672 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.811734:0:22663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839983.812104:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:3616:x1875734060840832:12345-0@lo:103:ldlm_bl.0 Request processed in 430us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.812111:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839983.812204:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060840832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839983.812865:0:22660:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788839983.812880:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060840960 00000100:00100000:0.0:1788839983.812884:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060840960 00000100:00100000:0.0:1788839983.812950:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839983.812958:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e44f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:22692:x1875734060840960:12345-0@lo:104: 00010000:00010000:0.0:1788839983.812970:0:22660:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839983.813022:0:22660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788839983.813027:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e44f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:22692:x1875734060840960:12345-0@lo:104: Request processed in 71us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839983.813032:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839983.813082:0:22692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060840960:0@lo:104: 00010000:00010000:3.0:1788839983.813160:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839983.813166:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813174:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69800 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839983.813178:0:22665:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813186:0:22665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839983.813193:0:22665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839983.813199:0:22665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839983.813225:0:22665:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813232:0:22665:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839983.813255:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813263:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab781e69800/0xad5b343a26574737 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657473e expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813278:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839983.813279:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839983.813281:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839983.813293:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060841088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839983.813328:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839983.813370:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060841088 00000100:00100000:3.0:1788839983.813374:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060841088 00010000:00010000:3.0:1788839983.813388:0:23433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab741465600/0xad5b343a2657473e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26574737 expref: 20 pid: 22669 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839983.813406:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839983.813412:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:3617:x1875734060841088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839983.813421:0:23433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839983.813426:0:23433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab741465600/0xad5b343a2657473e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26574737 expref: 20 pid: 22669 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813437:0:23433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab741465600/0xad5b343a2657473e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26574737 expref: 20 pid: 22669 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813449:0:23433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab741465600/0xad5b343a2657473e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26574737 expref: 20 pid: 22669 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813462:0:23433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813480:0:23433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788839983.813493:0:23433:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005635330s 00010000:00010000:3.0:1788839983.813497:0:23433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813504:0:23433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813511:0:23433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813518:0:23433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813523:0:23433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839983.813528:0:23433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813534:0:23433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813542:0:23433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839983.813553:0:23433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839983.813580:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:3617:x1875734060841088:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839983.813587:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839983.813652:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060841088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839983.813714:0:22692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839983.813724:0:22692:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839983.813730:0:22692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839983.813735:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de7400/0xad5b343a265747f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788839983.814706:0:24179:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788839983.823215:0:24179:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788839983.823228:0:24179:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788839983.823279:0:24179:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788839983.823332:0:24179:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788839983.823349:0:24179:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788839983.823368:0:24179:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788839983.824050:0:24179:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839983.824251:0:24179:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839984.383103:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788839984.811156:0:24259:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839984.811365:0:24259:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839985.408522:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839985.535067:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060841216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839985.535175:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839985.535224:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839985.535231:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060841344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839985.535253:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839985.535410:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060841216 00000100:00100000:2.0:1788839985.535418:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060841216 00000100:00100000:2.0:1788839985.535485:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060841344 00000100:00100000:2.0:1788839985.535489:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060841344 00000100:00100000:2.0:1788839985.535507:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788839985.535517:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060841216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788839985.535559:0:23417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788839985.535637:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060841216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839985.535643:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788839985.535659:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839985.535665:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060841344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788839985.535680:0:23417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788839985.535721:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060841344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839985.535728:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788839985.535901:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060841344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839985.535916:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060841216:0@lo:41:osp-pre-0-1.0 10000000:01000000:3.0:1788839985.731298:0:22674:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788839985.731306:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab7467ba000 from 13 10000000:01000000:3.0:1788839985.731372:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788839985.731419:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839985.731432:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839985.731444:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839985.731469:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060841472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839985.731538:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839985.731633:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839985.735803:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060841472 00000100:00100000:1.0:1788839985.735822:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060841472 00000100:00100000:1.0:1788839985.736107:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788839985.736119:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+19:22674:x1875734060841472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839985.736399:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839985.736423:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab746e4e600/0xad5b343a26574802 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265747fb expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839985.736453:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab746e4e600/0xad5b343a26574802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265747fb expref: 20 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839985.736463:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab746e4e600/0xad5b343a26574802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265747fb expref: 20 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839985.736473:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4e600, rc 0) 00000100:00100000:1.0:1788839985.736550:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:22674:x1875734060841472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 434us (5013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839985.736557:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788839985.737201:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060841472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839985.737225:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839985.737249:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839985.737314:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060841600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788839985.737358:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839985.737405:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768540 going to sleep for 11 seconds 00000100:00100000:3.0:1788839985.737998:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060841600 00000100:00100000:3.0:1788839985.738007:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060841600 00000100:00100000:3.0:1788839985.738065:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788839985.738076:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:22674:x1875734060841600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788839985.738097:0:22672:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788839985.738115:0:22672:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788839985.738118:0:22672:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788839985.738223:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:22674:x1875734060841600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839985.738230:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788839985.740265:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060841600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788839985.740378:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839985.740391:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839985.740403:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839985.740415:0:22674:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788839985.740418:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab781e72000 from 13 10000000:01000000:1.0:1788839985.740421:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788839985.740462:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839985.740471:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839985.740481:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839985.740502:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060841728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839985.740575:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839985.740637:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768540 going to sleep for 11 seconds 00000100:00100000:3.0:1788839985.740982:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060841728 00000100:00100000:3.0:1788839985.741009:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060841728 00000100:00100000:3.0:1788839985.741069:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788839985.741079:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:22674:x1875734060841728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839985.741092:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839985.741104:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574809 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839985.741729:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574809 expref: 21 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839985.741764:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574809 expref: 21 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839985.741821:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553c00, rc 0) 00000100:00100000:3.0:1788839985.742238:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:22674:x1875734060841728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1158us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839985.742248:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788839985.745537:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060841728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839985.745566:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839985.745580:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839985.745678:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060841856:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788839985.747094:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839985.747156:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768540 going to sleep for 11 seconds 00000100:00100000:1.0:1788839985.747198:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060841856 00000100:00100000:1.0:1788839985.747205:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060841856 00000100:00100000:1.0:1788839985.747260:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788839985.747270:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:22674:x1875734060841856:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788839985.747295:0:22670:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788839985.747313:0:22670:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788839985.747316:0:22670:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788839985.747416:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:22674:x1875734060841856:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839985.747424:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788839985.747469:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060841856:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788839985.747534:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839985.747546:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839985.747566:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839986.431392:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839987.461056:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839988.479125:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839989.122028:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060841984:0@lo:400:kworker.0 00000100:00100000:3.0:1788839989.122119:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839989.123932:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060842112:0@lo:400:kworker.0 00000100:00100000:1.0:1788839989.123987:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839989.124043:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060842112 00000100:00100000:1.0:1788839989.124051:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060842112 00000100:00100000:1.0:1788839989.124100:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839989.124109:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060842112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839989.124166:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060842112:12345-0@lo:400:kworker.0 Request processed in 58us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839989.124173:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839989.124209:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060842112:0@lo:400:kworker.0 00000100:00100000:3.0:1788839989.125959:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060841984 00000100:00100000:3.0:1788839989.125969:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060841984 00000100:00100000:3.0:1788839989.126045:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788839989.126054:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:3616:x1875734060841984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839989.126122:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:3616:x1875734060841984:12345-0@lo:400:kworker.0 Request processed in 70us (4027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839989.126128:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1788839989.126909:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839989.126915:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839989.126918:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839989.126921:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839989.126965:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839989.126968:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839989.126971:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839989.126974:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788839989.127098:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060842240:0@lo:400:kworker.0 00000100:00100000:0.0:1788839989.127214:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839989.127242:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060842752:0@lo:400:kworker.0 00000100:00100000:0.0:1788839989.127262:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839989.127283:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839989.127288:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060842368:0@lo:400:kworker.0 00000100:00100000:0.0:1788839989.127312:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839989.127346:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060842240 00000100:00100000:0.0:1788839989.127352:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060842240 00000100:00100000:0.0:1788839989.127387:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060842752 00000100:00100000:0.0:1788839989.127390:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060842752 00000100:00100000:0.0:1788839989.127437:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839989.127446:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060842240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839989.127495:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060842240:12345-0@lo:400:kworker.0 Request processed in 51us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839989.127502:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839989.127523:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839989.127530:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060842752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839989.127561:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060842752:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839989.127569:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839989.127594:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060842368 00000100:00100000:0.0:1788839989.127598:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060842368 00000100:00100000:0.0:1788839989.127622:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839989.127628:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060842368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839989.127660:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060842368:12345-0@lo:400:kworker.0 Request processed in 32us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839989.127667:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788839989.127699:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788839989.127747:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060842368:0@lo:400:kworker.0 00010000:00080000:0.0:1788839989.127763:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6476b1c00 x1875734060842240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839989.127817:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060842240:0@lo:400:kworker.0 00010000:00080000:0.0:1788839989.127830:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6476b0380 x1875734060842752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839989.127839:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060842752:0@lo:400:kworker.0 00000100:00100000:0.0:1788839989.127875:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060842624:0@lo:400:kworker.0 00000100:00100000:0.0:1788839989.127903:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839989.127921:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839989.127927:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060842496:0@lo:400:kworker.0 00000100:00100000:0.0:1788839989.127947:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839989.127968:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060842624 00000100:00100000:0.0:1788839989.127972:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060842624 00000100:00100000:0.0:1788839989.128070:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060842496 00000100:00100000:0.0:1788839989.128073:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060842496 00000100:00100000:0.0:1788839989.128086:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839989.128091:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060842624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839989.128240:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060842624:12345-0@lo:400:kworker.0 Request processed in 147us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839989.128246:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839989.128257:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788839989.128263:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060842496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839989.128286:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060842496:12345-0@lo:400:kworker.0 Request processed in 24us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839989.128291:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788839989.128304:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788839989.128349:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6476b3480 x1875734060842624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839989.128359:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060842624:0@lo:400:kworker.0 00010000:00080000:1.0:1788839989.128372:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6476b0000 x1875734060842496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839989.128380:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060842496:0@lo:400:kworker.0 00000100:00100000:3.0:1788839989.129331:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060841984:0@lo:400:kworker.0 00000001:02000400:2.0:1788839989.248119:0:24549:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788839989.504057:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839989.824377:0:22712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1788839990.056539:0:24601:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839990.056766:0:24601:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788839990.531026:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839990.655227:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060842880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839990.655297:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839990.655374:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060842880 00000100:00100000:1.0:1788839990.655380:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060842880 00000100:00100000:1.0:1788839990.655433:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788839990.655441:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060842880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839990.655472:0:22681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788839990.655510:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060842880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839990.655516:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788839990.655553:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060842880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839990.656032:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060843008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839990.656059:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839990.656146:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060843008 00000100:00100000:3.0:1788839990.656151:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060843008 00000100:00100000:3.0:1788839990.656182:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788839990.656188:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060843008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839990.656205:0:23417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788839990.656235:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060843008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839990.656241:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788839990.657088:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060843008:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1788839991.001434:0:24651:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839991.001650:0:24651:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839991.552486:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839992.575332:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788839992.703644:0:23431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839993.599902:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788839994.239522:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839994.239529:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839994.239531:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839994.239534:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839994.239553:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839994.239557:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839994.239559:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839994.239562:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839994.239619:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060843136:0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.239702:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839994.239748:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060843648:0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.239807:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839994.239847:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839994.239853:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060843520:0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.239879:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839994.239910:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060843392:0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.239934:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839994.239950:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060843904:0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.239975:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839994.239993:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788839994.239998:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060843264:0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.240018:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839994.240033:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060843776:0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.240049:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839994.240073:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060843136 00000100:00100000:3.0:1788839994.240080:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060843136 00000100:00100000:3.0:1788839994.240124:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788839994.240133:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:3617:x1875734060843136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.240178:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:3617:x1875734060843136:12345-0@lo:400:kworker.0 Request processed in 46us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839994.240185:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788839994.240217:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060843520 00000100:00100000:3.0:1788839994.240221:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060843520 00000100:00100000:3.0:1788839994.240243:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060843264 00000100:00100000:3.0:1788839994.240246:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060843264 00000100:00100000:3.0:1788839994.240260:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788839994.240266:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060843520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.240314:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060843520:12345-0@lo:400:kworker.0 Request processed in 46us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839994.240320:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788839994.240333:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788839994.240338:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060843264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.240369:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060843264:12345-0@lo:400:kworker.0 Request processed in 31us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839994.240374:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788839994.240391:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060843648 00000100:00100000:3.0:1788839994.240394:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060843648 00000100:00100000:3.0:1788839994.240442:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060843392 00000100:00100000:3.0:1788839994.240445:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060843392 00000100:00100000:3.0:1788839994.240458:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060843904 00000100:00100000:3.0:1788839994.240460:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060843904 00000100:00100000:3.0:1788839994.240481:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060843776 00000100:00100000:3.0:1788839994.240484:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060843776 00000100:00100000:3.0:1788839994.240495:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839994.240501:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060843648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.240531:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060843648:12345-0@lo:400:kworker.0 Request processed in 29us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839994.240536:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839994.240548:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839994.240553:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060843392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.240578:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060843392:12345-0@lo:400:kworker.0 Request processed in 25us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839994.240584:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839994.240595:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839994.240608:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060843904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.240636:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060843904:12345-0@lo:400:kworker.0 Request processed in 30us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839994.240642:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839994.240654:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839994.240659:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060843776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.240685:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060843776:12345-0@lo:400:kworker.0 Request processed in 26us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839994.240690:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839994.240746:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060843264:0@lo:400:kworker.0 00010000:00080000:3.0:1788839994.240760:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a49f80 x1875734060843776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839994.240790:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060843776:0@lo:400:kworker.0 00010000:00080000:3.0:1788839994.240801:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7443d9f80 x1875734060843392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839994.240809:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060843392:0@lo:400:kworker.0 00010000:00080000:3.0:1788839994.240819:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a48700 x1875734060843904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839994.240827:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060843904:0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.240862:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060843520:0@lo:400:kworker.0 00000100:00100000:3.0:1788839994.240871:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060843136:0@lo:400:kworker.0 00010000:00080000:3.0:1788839994.240879:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7443daa00 x1875734060843648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839994.240895:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060843648:0@lo:400:kworker.0 00000100:00080000:1.0:1788839994.246058:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839994.246068:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788839994.624163:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839995.071536:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839980/real 1788839980] req@ffff8ab6476b0e00 x1875734060836352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839995 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839995.071566:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab6476b0e00 x1875734060836352/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839995 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839995.071575:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839980/real 1788839980] req@ffff8ab6476b2d80 x1875734060836480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839995 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839995.071585:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab6476b2d80 x1875734060836480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839995 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788839995.071605:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab744349000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788839995.071637:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788839995.071649:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060836352:0@lo:8:kworker.0 00000100:00080000:1.0:1788839995.071656:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788839995.071664:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788839995.071666:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060836480:0@lo:8:kworker.0 00000100:00080000:2.0:1788839995.072057:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839995.072061:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788839995.072064:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839995.072067:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839995.074794:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060844032:0@lo:400:kworker.0 00000100:00100000:3.0:1788839995.074865:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839995.074914:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839995.074921:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060844160:0@lo:400:kworker.0 00000100:00100000:3.0:1788839995.074949:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839995.074984:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060844032 00000100:00100000:3.0:1788839995.074992:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060844032 00000100:00100000:3.0:1788839995.075039:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788839995.075048:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:3616:x1875734060844032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839995.075100:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:3616:x1875734060844032:12345-0@lo:400:kworker.0 Request processed in 53us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839995.075107:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788839995.075139:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060844160 00000100:00100000:3.0:1788839995.075142:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060844160 00000100:00100000:3.0:1788839995.075166:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788839995.075172:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060844160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839995.075205:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060844160:12345-0@lo:400:kworker.0 Request processed in 33us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839995.075211:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788839995.075249:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060844160:0@lo:400:kworker.0 00000100:00100000:3.0:1788839995.075257:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060844032:0@lo:400:kworker.0 00000100:00100000:3.0:1788839995.076910:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060844288:0@lo:400:kworker.0 00000100:00100000:3.0:1788839995.076980:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839995.077024:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839995.077032:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060844416:0@lo:400:kworker.0 00000100:00100000:3.0:1788839995.077056:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839995.077262:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060844288 00000100:00100000:1.0:1788839995.077269:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060844288 00000100:00100000:1.0:1788839995.077318:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788839995.077326:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060844288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839995.077381:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060844288:12345-0@lo:400:kworker.0 Request processed in 56us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839995.077388:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1788839995.077432:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab744354a80 x1875734060844288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839995.077444:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060844288:0@lo:400:kworker.0 00000100:00080000:2.0:1788839995.079422:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839995.079432:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788839995.079436:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab744349000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839995.079442:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 635 00000100:00080000:2.0:1788839995.079456:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788839995.079462:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ab744349000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839995.080042:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060844416 00000100:00100000:2.0:1788839995.080052:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060844416 00000100:00100000:2.0:1788839995.080101:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788839995.080110:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060844416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839995.080186:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060844416:12345-0@lo:400:kworker.0 Request processed in 77us (3129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839995.080193:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788839995.080400:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab744355500 x1875734060844544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839995.080428:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839995.080431:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788839995.080433:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788839995.082812:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060844416:0@lo:400:kworker.0 00000100:00080000:2.0:1788839995.083028:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 635 00000100:00080000:2.0:1788839995.083034:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788839995.083042:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ab6479d5800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839995.083130:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab744355180 x1875734060844672/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839995.083175:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060844800:0@lo:400:kworker.0 00000100:00100000:2.0:1788839995.083233:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839995.083360:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060844800 00000100:00100000:2.0:1788839995.083367:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060844800 00000100:00100000:3.0:1788839995.083615:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060844544:0@lo:8:kworker.0 00000100:00100000:3.0:1788839995.083653:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839995.083703:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060844672:0@lo:8:kworker.0 00000100:00100000:3.0:1788839995.083728:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839995.083763:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060844544 00000100:00100000:3.0:1788839995.083767:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060844544 00000100:00100000:2.0:1788839995.083944:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788839995.083955:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060844800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839995.084006:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060844800:12345-0@lo:400:kworker.0 Request processed in 53us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839995.084025:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788839995.084055:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060844672 00000100:00100000:2.0:1788839995.084059:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060844672 00000100:00100000:2.0:1788839995.084075:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839995.084080:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875734060844672:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788839995.084098:0:24183:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788839995.089100:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab744354a80 x1875734060844800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839995.089119:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060844800:0@lo:400:kworker.0 00000100:00100000:3.0:1788839995.089216:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839995.089228:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060845056:0@lo:400:kworker.0 00000100:00100000:3.0:1788839995.089299:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839995.089661:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060845056 00000100:00100000:1.0:1788839995.089670:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060845056 00000100:00100000:1.0:1788839995.089726:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788839995.089736:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060845056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839995.089837:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060845056:12345-0@lo:400:kworker.0 Request processed in 102us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839995.089844:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788839995.089880:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a4a300 x1875734060845056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839995.089891:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060845056:0@lo:400:kworker.0 00000100:00100000:1.0:1788839995.089920:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839995.089927:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060844928:0@lo:400:kworker.0 00000100:00100000:1.0:1788839995.089952:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839995.096989:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060844928 00000100:00100000:0.0:1788839995.097004:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060844928 00000100:00100000:0.0:1788839995.097069:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788839995.097080:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060844928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839995.097173:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060844928:12345-0@lo:400:kworker.0 Request processed in 95us (7219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839995.097187:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788839995.097252:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a4b480 x1875734060844928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840011 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839995.097267:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060844928:0@lo:400:kworker.0 00000100:00100000:3.0:1788839995.129308:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875734060844672:12345-0@lo:8:kworker.0 Request processed in 45219us (45571us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788839995.129321:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839995.129353:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839995.129359:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875734060844544:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788839995.129387:0:24183:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 650 last 0 00000020:00000080:3.0:1788839995.129416:0:24183:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26574817 00002000:00100000:3.0:1788839995.129435:0:24183:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ab7477a9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788839995.129438:0:24183:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788839995.129448:0:24183:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788839995.129623:0:24183:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788839995.129647:0:24183:0:(import.c:65:import_set_state_nolock()) ffff8ab7477ae000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839995.129697:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1875734060844544:12345-0@lo:8:kworker.0 Request processed in 327us (46033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839995.129704:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788839995.130612:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788839995.130621:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788839995.130625:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060844672:0@lo:8:kworker.0 00010000:00080000:1.0:1788839995.130645:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab744355500 x1875734060844544/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788840015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839995.130655:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788839995.130662:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788839995.130669:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788839995.130673:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788839995.130676:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab744349000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788839995.130702:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788839995.130706:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060844544:0@lo:8:kworker.0 00000004:00080000:3.0:1788839995.130976:0:23420:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788839995.130999:0:23420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23420:1875734060845312:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788839995.131047:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839995.131072:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6410b0900 going to sleep for 11 seconds 00000004:00080000:3.0:1788839995.131087:0:23419:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788839995.131166:0:23419:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 650075395460ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788839995.131174:0:23419:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788839995.131199:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060845312 00000100:00100000:3.0:1788839995.131206:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060845312 00000100:00100000:3.0:1788839995.131250:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839995.131258:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23420:x1875734060845312:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788839995.132703:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060845184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839995.132761:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788839995.132839:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839995.133137:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060845184 00000100:00100000:0.0:1788839995.133145:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060845184 00000100:00100000:0.0:1788839995.133194:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839995.133203:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3615:x1875734060845184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839995.133227:0:24187:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788839995.133274:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3615:x1875734060845184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839995.133281:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788839995.135652:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a4ad80 x1875734060845184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788840011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839995.135694:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060845184:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1788839995.138399:0:23409:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1788839995.138760:0:24185:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788839995.138781:0:24185:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788839995.138890:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23420:x1875734060845312:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7628us (7837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839995.138901:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788839995.139010:0:23420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a49c00 x1875734060845312/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788840011 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839995.139027:0:23420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23420:1875734060845312:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788839995.139057:0:23420:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788839995.139102:0:23420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23420:1875734060845440:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788839995.139138:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839995.139172:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839995.139312:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060845440 00000100:00100000:2.0:1788839995.139319:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060845440 00000100:00100000:2.0:1788839995.139364:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839995.139373:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23420:x1875734060845440:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788839995.139396:0:24183:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788839995.139435:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23420:x1875734060845440:12345-0@lo:5:osp-pre-0-1.0 Request processed in 64us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839995.139440:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788839995.139973:0:23420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab646b4df80 x1875734060845440/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788840011 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839995.139985:0:23420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23420:1875734060845440:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788839995.139997:0:23420:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788839995.140034:0:23420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23420:1875734060845568:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788839995.140065:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839995.140085:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839995.140174:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060845568 00000100:00100000:2.0:1788839995.140179:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060845568 00000100:00100000:2.0:1788839995.140210:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839995.140216:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23420:x1875734060845568:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788839995.140273:0:24185:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:0.0:1788839995.177000:0:24180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1788839995.177018:0:24180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788839995.177224:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23420:x1875734060845568:12345-0@lo:5:osp-pre-0-1.0 Request processed in 37002us (37152us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788839995.177235:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788839995.177349:0:23420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7766ec380 x1875734060845568/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788840011 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839995.177362:0:23420:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788839995.177377:0:23420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23420:1875734060845568:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788839995.177393:0:23420:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1788839995.177440:0:23420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23420:1875734060845696:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788839995.177494:0:23420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839995.177523:0:23420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839995.177666:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060845696 00000100:00100000:2.0:1788839995.177684:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060845696 00000100:00100000:2.0:1788839995.177742:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839995.177751:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23420:x1875734060845696:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788839995.177833:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23420:x1875734060845696:12345-0@lo:900:osp-pre-0-1.0 Request processed in 83us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839995.177840:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788839995.177883:0:23420:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7766ec380 x1875734060845696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788840011 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839995.177894:0:23420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23420:1875734060845696:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788839995.647135:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839995.775150:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060845824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839995.775220:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839995.775354:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060845824 00000100:00100000:3.0:1788839995.775361:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060845824 00000100:00100000:3.0:1788839995.775408:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839995.775418:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060845824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839995.775449:0:22681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788839995.775501:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060845824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839995.775508:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839995.775552:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060845824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839995.775580:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839995.775586:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060845952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839995.775609:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839995.775632:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060845952 00000100:00100000:3.0:1788839995.775635:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060845952 00000100:00100000:3.0:1788839995.775655:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788839995.775661:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060845952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839995.775677:0:23417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788839995.775720:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060845952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839995.775726:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788839995.775750:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060845952:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788839996.686615:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788839997.579309:0:24997:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788839997.579313:0:24997:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788839997.579314:0:24997:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788839997.579494:0:24997:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab7477ad800 00000020:01000004:3.0:1788839997.579511:0:24997:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788839997.579524:0:24997:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788839997.579537:0:24997:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ab746fdb370) 00000020:00000080:3.0:1788839997.579553:0:24997:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788839997.645010:0:24997:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788839997.649177:0:24997:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1788839997.649445:0:24997:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788839997.650173:0:24997:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788839997.650400:0:24997:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788839997.650639:0:24997:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788839997.650947:0:24997:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788839997.652227:0:24997:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788839997.652441:0:24997:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788839997.652455:0:24997:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788839997.652466:0:24997:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xad5b343a26574825 00000020:01000004:2.0:1788839997.652472:0:24997:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788839997.652493:0:24997:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788839997.652496:0:24997:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788839997.652501:0:24997:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788839997.652524:0:24997:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788839997.652527:0:24997:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788839997.666647:0:24997:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788839997.666708:0:24997:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788839997.666712:0:24997:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788839997.666714:0:24997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788839997.666715:0:24997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839997.666716:0:24997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839997.666718:0:24997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839997.666719:0:24997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839997.666720:0:24997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839997.666722:0:24997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839997.666729:0:24997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839997.666732:0:24997:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788839997.666734:0:24997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788839997.666735:0:24997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788839997.666736:0:24997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839997.666737:0:24997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839997.666738:0:24997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839997.666739:0:24997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839997.666740:0:24997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839997.666741:0:24997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839997.666741:0:24997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839997.667505:0:24997:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788839997.667532:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846080:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788839997.667619:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839997.667734:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f960c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839997.669936:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060846080 00000100:00100000:1.0:1788839997.669951:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060846080 00000100:00100000:1.0:1788839997.670023:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788839997.670034:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24997:x1875734060846080:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788839997.670083:0:22670:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788839997.670087:0:22670:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788839997.670091:0:22670:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788839997.670551:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24997:x1875734060846080:12345-0@lo:253:mount.lustre.0 Request processed in 518us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839997.670559:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788839997.670644:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846080:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788839997.670666:0:24997:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788839997.670676:0:24997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839997.670678:0:24997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788839997.670679:0:24997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839997.670680:0:24997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839997.670682:0:24997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839997.670683:0:24997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839997.670684:0:24997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839997.670686:0:24997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839997.670687:0:24997:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788839997.670707:0:24997:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab7477ad800 from lustre-OST0001 10000000:01000000:3.0:1788839997.670735:0:24997:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788839997.670737:0:24997:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788839997.670745:0:24997:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab6419419b8 local copy 00010000:00010000:3.0:1788839997.670755:0:24997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839997.670906:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846208:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839997.670953:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839997.671000:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f96840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839997.671230:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060846208 00000100:00100000:0.0:1788839997.671236:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060846208 00000100:00100000:0.0:1788839997.671274:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788839997.671282:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24997:x1875734060846208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839997.671358:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24997:x1875734060846208:12345-0@lo:501:mount.lustre.0 Request processed in 77us (405us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839997.671366:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788839997.671469:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846208:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788839997.671483:0:24997:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788839997.671502:0:24997:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788839997.671508:0:24997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.671519:0:24997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a2657453f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574546 expref: -99 pid: 22656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839997.671553:0:24997:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab7477ad800 10000000:01000000:2.0:1788839997.671557:0:24997:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788839997.671562:0:24997:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788839997.671565:0:24997:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788839997.671569:0:24997:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788839997.671572:0:24997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788839997.671594:0:24997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a2657482c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.671602:0:24997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a2657482c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.671610:0:24997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a2657482c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839997.671623:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788839997.671651:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.671884:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788839997.671935:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060846336 00000100:00100000:3.0:1788839997.671940:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060846336 00000100:00100000:3.0:1788839997.671973:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788839997.671980:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:24997:x1875734060846336:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839997.671988:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839997.672000:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552a00/0xad5b343a26574833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657482c expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839997.672021:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552a00/0xad5b343a26574833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657482c expref: 22 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839997.672031:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552a00/0xad5b343a26574833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657482c expref: 22 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839997.672038:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552a00, rc 0) 00000100:00100000:3.0:1788839997.672287:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:24997:x1875734060846336:12345-0@lo:101:mount.lustre.0 Request processed in 306us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839997.672294:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788839997.672472:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839997.672486:0:24997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a2657482c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574833 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.672494:0:24997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a2657482c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574833 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839997.673643:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1788839997.675155:0:24997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839997.677495:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788839997.677548:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788839997.677564:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788839997.677580:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788839997.677593:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788839997.677609:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788839997.677621:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788839997.677634:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788839997.677647:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788839997.677752:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788839997.677758:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788839997.678144:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839997.678211:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.678307:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788839997.678352:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060846464 00000100:00100000:0.0:1788839997.678359:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060846464 00000100:00100000:0.0:1788839997.678448:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788839997.678459:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:24997:x1875734060846464:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839997.678602:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:24997:x1875734060846464:12345-0@lo:501:mount.lustre.0 Request processed in 144us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839997.678609:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788839997.678693:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839997.678726:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839997.678810:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.679099:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839997.679171:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060846592 00000100:00100000:3.0:1788839997.679177:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060846592 00000100:00100000:3.0:1788839997.679202:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788839997.679208:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:24997:x1875734060846592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839997.679915:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:24997:x1875734060846592:12345-0@lo:503:mount.lustre.0 Request processed in 704us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839997.679923:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788839997.680022:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846592:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788839997.680413:0:24997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788839997.680486:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839997.680528:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.680562:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839997.680613:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060846720 00000100:00100000:0.0:1788839997.680619:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060846720 00000100:00100000:0.0:1788839997.680649:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788839997.680668:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:24997:x1875734060846720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839997.681190:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:24997:x1875734060846720:12345-0@lo:502:mount.lustre.0 Request processed in 531us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839997.681197:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788839997.681294:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788839997.681451:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788839997.681476:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788839997.681488:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788839997.681499:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788839997.681519:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788839997.681530:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788839997.681540:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788839997.681552:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788839997.681567:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788839997.681591:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839997.681628:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.681665:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788839997.681825:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060846848 00000100:00100000:3.0:1788839997.681837:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060846848 00000100:00100000:3.0:1788839997.681862:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788839997.681869:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:24997:x1875734060846848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839997.681965:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:24997:x1875734060846848:12345-0@lo:502:mount.lustre.0 Request processed in 96us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839997.681972:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788839997.682301:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788839997.682346:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788839997.682355:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788839997.683127:0:25001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788839997.683135:0:25001:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788839997.683143:0:25001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839997.683145:0:25001:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788839997.683151:0:25001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839997.683165:0:25001:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ab7487d4d28) 00000020:00000080:2.0:1788839997.683189:0:25001:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788839997.683195:0:25001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788839997.683260:0:25001:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab7477ad800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788839997.683268:0:25001:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788839997.683275:0:25001:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xad5b343a26574841 00010000:00010000:2.0:1788839997.692573:0:25001:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788839997.693411:0:25001:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00010000:00010000:3.0:1788839997.696400:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788839997.700103:0:25001:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788839997.703103:0:25001:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788839997.703115:0:25001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839997.703121:0:25001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839997.703124:0:25001:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788839997.703127:0:25001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839997.703131:0:25001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839997.703132:0:25001:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788839997.703136:0:25001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788839997.703137:0:25001:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788839997.703140:0:25001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839997.703142:0:25001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839997.703143:0:25001:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788839997.703145:0:25001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839997.703220:0:25001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839997.703222:0:25001:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788839997.703227:0:25001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788839997.703257:0:25001:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839997.703260:0:25001:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839997.703262:0:25001:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788839997.703264:0:25001:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788839997.703457:0:24997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788839997.703487:0:24997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788839997.703510:0:24997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a2657482c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574833 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.703536:0:24997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a2657482c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574833 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839997.703544:0:24997:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab7477ad800 from 1 10000000:01000000:2.0:1788839997.703547:0:24997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788839997.703581:0:24997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.703589:0:24997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.703599:0:24997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839997.703625:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788839997.704286:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.704327:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746a52600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839997.704410:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060846976 00000100:00100000:3.0:1788839997.704417:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060846976 00000100:00100000:3.0:1788839997.704555:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788839997.704566:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:24997:x1875734060846976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839997.704590:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839997.704604:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552200/0xad5b343a2657484f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574848 expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839997.704627:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552200/0xad5b343a2657484f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574848 expref: 23 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839997.704638:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552200/0xad5b343a2657484f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574848 expref: 23 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839997.704646:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552200, rc 0) 00000100:00100000:3.0:1788839997.704713:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:24997:x1875734060846976:12345-0@lo:101:mount.lustre.0 Request processed in 150us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839997.704721:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788839997.704828:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060846976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839997.704845:0:24997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.704854:0:24997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839997.706254:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788839997.706497:0:24997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839997.706676:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788839997.706704:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788839997.706742:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788839997.706759:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788839997.709106:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788839997.709168:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788839997.709184:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788839997.709198:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788839997.709212:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788839997.709225:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788839997.709237:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788839997.709258:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788839997.709264:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788839997.709479:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839997.709544:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.714118:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5840 going to sleep for 11 seconds 00000100:00100000:1.0:1788839997.715088:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060847104 00000100:00100000:1.0:1788839997.715098:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060847104 00000100:00100000:1.0:1788839997.715146:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788839997.716103:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:24997:x1875734060847104:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839997.716281:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:24997:x1875734060847104:12345-0@lo:501:mount.lustre.0 Request processed in 185us (6737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839997.716288:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788839997.716517:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839997.716566:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847232:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839997.716609:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839997.716635:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768840 going to sleep for 11 seconds 00000100:00100000:1.0:1788839997.716756:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060847232 00000100:00100000:1.0:1788839997.716762:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060847232 00000100:00100000:1.0:1788839997.717053:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788839997.717062:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:24997:x1875734060847232:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839997.717141:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:24997:x1875734060847232:12345-0@lo:503:mount.lustre.0 Request processed in 80us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839997.717238:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847232:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788839997.717614:0:24997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839997.717699:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839997.717735:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839997.717759:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060847360 00000100:00100000:0.0:1788839997.717764:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060847360 00000100:00100000:0.0:1788839997.724404:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788839997.724418:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060847360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839997.724599:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060847360:12345-0@lo:502:mount.lustre.0 Request processed in 184us (6863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839997.724608:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788839997.724819:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788839997.725048:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839997.725074:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839997.725615:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788839997.725649:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1788839997.726129:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1788839997.726219:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1788839997.726242:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1788839997.726258:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788839997.726273:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1788839997.726288:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1788839997.726304:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1788839997.728233:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1788839997.728280:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1788839997.728990:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839997.729073:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839997.729621:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839997.733107:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060847488 00000100:00100000:3.0:1788839997.733123:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060847488 00000100:00100000:3.0:1788839997.733574:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788839997.733585:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:24997:x1875734060847488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839997.734036:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:24997:x1875734060847488:12345-0@lo:502:mount.lustre.0 Request processed in 452us (4961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839997.734044:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788839997.734273:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839997.734364:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788839997.734378:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788839997.739253:0:25005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839997.739265:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839997.739268:0:25005:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788839997.739276:0:25005:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab7477ad800 00000020:00000080:0.0:1788839997.739279:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839997.739286:0:25005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839997.739289:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839997.739290:0:25005:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788839997.739293:0:25005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839997.739296:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839997.739297:0:25005:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788839997.739300:0:25005:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab7477ad800 00000020:00000080:0.0:1788839997.739303:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839997.739363:0:25005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839997.739367:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839997.739368:0:25005:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788839997.739371:0:25005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839997.739373:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839997.739374:0:25005:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788839997.739378:0:25005:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab7477ad800 00000020:00000080:0.0:1788839997.739380:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839997.739398:0:25005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839997.739401:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839997.739403:0:25005:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788839997.739419:0:25005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839997.739422:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839997.739423:0:25005:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788839997.739426:0:25005:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab7477ad800 00000020:00000080:0.0:1788839997.739428:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839997.739454:0:25005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839997.739456:0:25005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839997.739457:0:25005:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788839997.739460:0:25005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788839997.739721:0:24997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788839997.739749:0:24997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839997.739798:0:24997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839997.739811:0:24997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839997.739869:0:24997:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788839997.739872:0:24997:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab7477ad800 10000000:01000000:3.0:1788839997.739875:0:24997:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab7477ad800 10000000:01000000:3.0:1788839997.739879:0:24997:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839997.739885:0:24997:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab7477ad800 from 1 10000000:01000000:3.0:1788839997.739888:0:24997:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788839997.739923:0:24997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a26574856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839997.739931:0:24997:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a26574856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839997.739940:0:24997:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a26574856 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839997.739963:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839997.740026:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839997.740065:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f96180 going to sleep for 11 seconds 00000100:00100000:0.0:1788839997.741917:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060847616 00000100:00100000:0.0:1788839997.741927:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060847616 00000100:00100000:0.0:1788839997.741986:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788839997.741996:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:24997:x1875734060847616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839997.742011:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839997.742027:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab781e69000/0xad5b343a2657485d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574856 expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.742051:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab781e69000/0xad5b343a2657485d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574856 expref: 24 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.742061:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab781e69000/0xad5b343a2657485d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574856 expref: 24 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.742070:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e69000, rc 0) 00000100:00100000:0.0:1788839997.742133:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060847616:12345-0@lo:101:mount.lustre.0 Request processed in 138us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839997.742139:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788839997.742280:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839997.742298:0:24997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a26574856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657485d expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839997.742308:0:24997:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a26574856 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657485d expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839997.755915:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788839997.766707:0:24997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839997.766983:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788839997.767011:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788839997.767028:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788839997.767042:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788839997.767053:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788839997.767063:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788839997.767074:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788839997.767087:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788839997.767100:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788839997.767114:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788839997.767125:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788839997.767138:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788839997.767164:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788839997.767179:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788839997.767192:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788839997.767203:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788839997.767215:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788839997.767252:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788839997.767268:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788839997.767282:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788839997.767296:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788839997.767309:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788839997.767320:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788839997.767344:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788839997.767357:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788839997.767368:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788839997.767380:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788839997.767393:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788839997.767405:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788839997.767416:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788839997.767427:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788839997.767437:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788839997.767449:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788839997.767475:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788839997.767489:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788839997.767503:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788839997.767516:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788839997.767528:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788839997.767540:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788839997.767552:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788839997.767565:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788839997.767578:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788839997.767590:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788839997.767601:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788839997.767612:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788839997.767624:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788839997.767636:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788839997.767648:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788839997.767814:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788839997.767836:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788839997.767863:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788839997.767869:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788839997.778281:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839997.778755:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.779436:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788839997.779691:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060847744 00000100:00100000:1.0:1788839997.779698:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060847744 00000100:00100000:1.0:1788839997.779756:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788839997.779910:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060847744:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839997.780271:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060847744:12345-0@lo:501:mount.lustre.0 Request processed in 364us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839997.780314:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788839997.780506:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839997.780553:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839997.780599:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.780628:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788839997.780639:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060847872 00000100:00100000:1.0:1788839997.780644:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060847872 00000100:00100000:1.0:1788839997.780666:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788839997.780686:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060847872:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839997.780758:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060847872:12345-0@lo:503:mount.lustre.0 Request processed in 73us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839997.780914:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788839997.781303:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060847872:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788839997.784267:0:24997:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788839997.784414:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060848000:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839997.784484:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.784527:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788839997.784562:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060848000 00000100:00100000:1.0:1788839997.784569:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060848000 00000100:00100000:1.0:1788839997.784613:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788839997.784622:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060848000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839997.784741:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060848000:12345-0@lo:502:mount.lustre.0 Request processed in 120us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839997.784750:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788839997.784898:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060848000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839997.785257:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788839997.785295:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788839997.785313:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788839997.785329:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788839997.785343:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788839997.785358:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788839997.785376:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788839997.785396:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788839997.785412:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788839997.785432:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788839997.785452:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788839997.785467:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788839997.785481:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788839997.785494:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788839997.785524:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788839997.785547:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788839997.785564:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788839997.785580:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788839997.785595:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788839997.785612:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788839997.785630:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788839997.785647:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788839997.785662:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788839997.785690:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788839997.785705:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788839997.785717:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788839997.785727:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788839997.785740:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788839997.785753:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788839997.785850:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788839997.785884:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788839997.785902:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788839997.785917:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788839997.785931:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788839997.785954:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788839997.785967:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788839997.785979:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788839997.785991:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788839997.786004:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788839997.786017:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788839997.786030:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788839997.786043:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788839997.786057:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788839997.786070:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788839997.786197:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788839997.786216:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788839997.786247:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788839997.786266:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788839997.786308:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060848128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839997.786362:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839997.786398:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75ff52480 going to sleep for 11 seconds 00000100:00100000:1.0:1788839997.786560:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060848128 00000100:00100000:1.0:1788839997.786566:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060848128 00000100:00100000:1.0:1788839997.786597:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788839997.786604:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060848128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839997.786717:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060848128:12345-0@lo:502:mount.lustre.0 Request processed in 112us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839997.786724:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788839997.786851:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060848128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839997.786984:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788839997.787003:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788839997.787024:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060848256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839997.787067:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839997.787114:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75ff52480 going to sleep for 11 seconds 00000100:00100000:2.0:1788839997.787233:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060848256 00000100:00100000:2.0:1788839997.787239:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060848256 00000100:00100000:2.0:1788839997.787275:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788839997.787282:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060848256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839997.787868:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060848256:12345-0@lo:502:mount.lustre.0 Request processed in 585us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839997.787877:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788839997.788274:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060848256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839997.789498:0:24997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788839997.789516:0:24997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788839997.806341:0:25010:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788839997.806363:0:25010:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ab746fd99b8) 00000020:00000080:3.0:1788839997.806391:0:25010:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788839997.806494:0:25010:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab7477ad800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788839997.806499:0:25010:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab7477ad800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788839997.806501:0:25010:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab7477ad800 3 00010000:00080000:3.0:1788839997.806531:0:25010:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab647449800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788839997.809248:0:25010:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788839997.809521:0:25010:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788839997.809567:0:25010:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788839997.809579:0:25010:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xad5b343a2657486b 00000100:00080000:3.0:1788839997.809588:0:25010:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839997.809594:0:25010:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab647449800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839997.809626:0:25010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab781a4ad80 x1875734060848384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839997.809653:0:25010:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788839997.810633:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060848384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788839997.811297:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788839997.811327:0:25010:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:0.0:1788839997.811335:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060848384 00000020:00000080:3.0:1788839997.811342:0:25010:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8ab746fdcd28) 00000100:00100000:0.0:1788839997.811343:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060848384 00000020:00000080:3.0:1788839997.811361:0:25010:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:0.0:1788839997.811375:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839997.811382:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060848384:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788839997.811412:0:22676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000020:01000004:3.0:1788839997.811445:0:25010:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab7477ad800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788839997.811450:0:25010:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab7477ad800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788839997.811452:0:25010:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab7477ad800 3 00000020:00000080:0.0:1788839997.811456:0:22676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xad5b343a26574879 00000100:00080000:1.0:1788839997.811760:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839997.811764:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839997.811767:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839997.811784:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1788839997.812151:0:25010:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab64744c000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.152@tcp at head 00000100:00080000:1.0:1788839997.812259:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839997.812263:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788839997.812266:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788839997.812271:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 650 00000100:00080000:1.0:1788839997.812276:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788839997.812290:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ab6479d5800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839997.812310:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819f9c00 x1875734060849024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839997.812436:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060848512:0@lo:400:kworker.0 00000100:00100000:2.0:1788839997.812483:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.812512:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839997.812519:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060848640:0@lo:400:kworker.0 00000100:00100000:2.0:1788839997.812554:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.812583:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060848512 00000100:00100000:2.0:1788839997.812588:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060848512 00000100:00100000:2.0:1788839997.812627:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788839997.812635:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060848512:12345-0@lo:400:kworker.0 00000004:00100000:0.0:1788839997.812887:0:22676:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788839997.812925:0:22676:0:(import.c:65:import_set_state_nolock()) ffff8ab77e5ce800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839997.812970:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1875734060848384:12345-0@lo:38:llog_process_th.0 Request processed in 1586us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839997.812979:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839997.812996:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060848640 00000100:00100000:0.0:1788839997.812999:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060848640 00000100:00100000:0.0:1788839997.813026:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788839997.813033:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060848640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839997.813068:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060848640:12345-0@lo:400:kworker.0 Request processed in 35us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839997.813077:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788839997.813111:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060849280:0@lo:400:kworker.0 00000100:00100000:1.0:1788839997.813140:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839997.813422:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839997.813430:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060849152:0@lo:400:kworker.0 00000100:00100000:1.0:1788839997.813456:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839997.813489:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060848768:0@lo:400:kworker.0 00000100:00100000:1.0:1788839997.813518:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839997.813539:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060849408:0@lo:400:kworker.0 00000100:00100000:1.0:1788839997.813560:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839997.813574:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839997.813579:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060848896:0@lo:400:kworker.0 00000100:00100000:1.0:1788839997.813604:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839997.813642:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060849280 00000100:00100000:1.0:1788839997.813646:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060849280 00000100:00100000:2.0:1788839997.814253:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060848512:12345-0@lo:400:kworker.0 Request processed in 1617us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839997.814263:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788839997.814281:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060848768 00000100:00100000:2.0:1788839997.814284:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060848768 00000100:00100000:1.0:1788839997.815082:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060849152 00000100:00100000:1.0:1788839997.815089:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060849152 00010000:00010000:3.0:1788839997.815239:0:25010:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788839997.815415:0:25010:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788839997.815465:0:25010:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788839997.815475:0:25010:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xad5b343a26574880 00000100:00080000:3.0:1788839997.815481:0:25010:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839997.815485:0:25010:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ab64744c000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839997.815510:0:25010:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab781a4b480 x1875734060849536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839997.815524:0:25010:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788839997.815603:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839997.815615:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060848768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839997.815703:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060848768:12345-0@lo:400:kworker.0 Request processed in 92us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839997.815710:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839997.815729:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060849408 00000100:00100000:2.0:1788839997.815733:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060849408 00000100:00100000:2.0:1788839997.815752:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788839997.815758:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060849280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839997.815824:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060849280:12345-0@lo:400:kworker.0 Request processed in 65us (2681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839997.815830:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788839997.815844:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839997.815850:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060849408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839997.815877:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060849408:12345-0@lo:400:kworker.0 Request processed in 28us (2316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839997.815908:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788839997.815954:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fb480 x1875734060848640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839997.815969:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060848640:0@lo:400:kworker.0 00000100:00100000:2.0:1788839997.815985:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060848512:0@lo:400:kworker.0 00000100:00100000:3.0:1788839997.816017:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060848768:0@lo:400:kworker.0 00010000:00080000:3.0:1788839997.816036:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fad80 x1875734060849408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839997.816043:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060849408:0@lo:400:kworker.0 00010000:00080000:2.0:1788839997.816049:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fa300 x1875734060849280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839997.816058:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060849280:0@lo:400:kworker.0 00000100:00100000:1.0:1788839997.816504:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839997.816512:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060849152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839997.816556:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060849152:12345-0@lo:400:kworker.0 Request processed in 45us (3100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839997.816563:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839997.816601:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060848896 00000100:00100000:1.0:1788839997.816606:0:24186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060848896 00000100:00100000:1.0:1788839997.816645:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788839997.816752:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9500 x1875734060849152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839997.816763:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060849152:0@lo:400:kworker.0 00000100:00100000:1.0:1788839997.817259:0:24186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060848896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839997.817311:0:24186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060848896:12345-0@lo:400:kworker.0 Request processed in 659us (3705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839997.817319:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788839997.817348:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839997.817354:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839997.817356:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788839997.817410:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f8000 x1875734060848896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788840013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839997.817420:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060848896:0@lo:400:kworker.0 00000100:00100000:1.0:1788839997.817442:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060849024:0@lo:8:kworker.0 00000100:00100000:1.0:1788839997.817474:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839997.817498:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875734060849536:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788839997.817537:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839997.817576:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060849536 00010000:00080000:1.0:1788839997.817578:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab781a4ad80 x1875734060848384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788840007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839997.817582:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060849536 00000100:00100000:1.0:1788839997.817591:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788839997.817599:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788839997.817607:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788839997.817611:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:0.0:1788839997.817615:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788839997.817617:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647449800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788839997.817624:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875734060849536:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788839997.817627:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060848384:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788839997.817652:0:22677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 652 last 0 00000100:00100000:1.0:1788839997.817679:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060849024 00000100:00100000:1.0:1788839997.817684:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060849024 00000100:00100000:1.0:1788839997.817716:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000020:00000080:0.0:1788839997.817716:0:22677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xad5b343a26574887 00000100:00100000:1.0:1788839997.817724:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875734060849024:12345-0@lo:8:kworker.0 00000004:00100000:0.0:1788839997.817735:0:22677:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788839997.817800:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875734060849024:12345-0@lo:8:kworker.0 Request processed in 63us (312us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788839997.817806:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839997.817839:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788839997.817843:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788839997.817847:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788839997.817850:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060849024:0@lo:8:kworker.0 00000100:00080000:1.0:1788839997.817880:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839997.817884:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839997.817887:0:22677:0:(import.c:65:import_set_state_nolock()) ffff8ab77e5cb000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788839997.817888:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788839997.817935:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1875734060849536:12345-0@lo:38:llog_process_th.0 Request processed in 311us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839997.817943:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788839997.818624:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:1.0:1788839997.818692:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab781a4b480 x1875734060849536/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788840007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839997.818702:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788839997.818707:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1788839997.818712:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788839997.818716:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788839997.818718:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab64744c000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788839997.818724:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875734060849536:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788839997.820202:0:25010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788839997.820558:0:24997:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788839997.820589:0:24997:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788839997.820615:0:24997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a26574856 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657485d expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839997.820627:0:24997:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a26574856 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657485d expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788839997.820684:0:24997:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788839997.820687:0:24997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788839997.820688:0:24997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839997.820690:0:24997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839997.820691:0:24997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839997.820692:0:24997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839997.820694:0:24997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839997.820696:0:24997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839997.820697:0:24997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788839997.820700:0:24997:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788839997.820703:0:24997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788839997.820704:0:24997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788839997.820705:0:24997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839997.820706:0:24997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839997.820707:0:24997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839997.820708:0:24997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839997.820709:0:24997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839997.820710:0:24997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839997.820711:0:24997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788839997.820736:0:24997:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788839997.820755:0:24997:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060849664:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788839997.820973:0:24997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839997.821052:0:24997:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75ff529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839997.821125:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060849664 00000100:00100000:2.0:1788839997.821132:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060849664 00000100:00100000:2.0:1788839997.821219:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788839997.821230:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060849664:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788839997.821256:0:22669:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788839997.821270:0:22669:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788839997.837011:0:22669:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788839997.837029:0:22669:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788839997.837048:0:22692:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788839997.837054:0:22692:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788839997.837078:0:22692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.837097:0:22692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab746e4e600/0xad5b343a26574802 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265747fb expref: 24 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.837105:0:22692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574809 expref: 24 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.837113:0:22692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.837154:0:22692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26574809 expref: 24 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.837180:0:22692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26574809 expref: 24 pid: 22669 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839997.837193:0:22692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060849792:0@lo:104: 00000100:00100000:0.0:1788839997.837264:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839997.837320:0:22692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab746e4e600/0xad5b343a26574802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265747fb expref: 24 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.837329:0:22692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab746e4e600/0xad5b343a26574802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265747fb expref: 24 pid: 22670 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839997.837337:0:22692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060849920:0@lo:104: 00000100:00100000:2.0:1788839997.837369:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:24997:x1875734060849664:12345-0@lo:253:mount.lustre.0 Request processed in 16137us (16392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839997.837374:0:22692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.837384:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788839997.837407:0:24997:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:24997:1875734060849664:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788839997.837422:0:24997:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788839997.837424:0:24997:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788839997.837435:0:24997:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788839997.837436:0:24997:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839997.837438:0:24997:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839997.837440:0:24997:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839997.837441:0:24997:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839997.837443:0:24997:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839997.837445:0:24997:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839997.837446:0:24997:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788839997.837462:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060849792 00000020:02000000:1.0:1788839997.837463:0:24997:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788839997.837472:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060849792 00000100:00100000:3.0:1788839997.837508:0:22661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060849920 00000100:00100000:3.0:1788839997.837512:0:22661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060849920 00000100:00100000:3.0:1788839997.837529:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839997.837538:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+4:22692:x1875734060849792:12345-0@lo:104: 00010000:00010000:3.0:1788839997.837551:0:22661:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839997.837580:0:22692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839997.837605:0:22692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060849792:0@lo:104: 00010000:00010000:3.0:1788839997.837622:0:22661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839997.837629:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+4:22692:x1875734060849792:12345-0@lo:104: Request processed in 93us (365us total) trans 0 rc 0/0 00010000:00010000:1.0:1788839997.837631:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788839997.837640:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788839997.837640:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.837652:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4e400 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839997.837656:0:22666:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.837665:0:22666:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839997.837679:0:22661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 10000000:00010000:1.0:1788839997.837688:0:22666:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839997.837692:0:22661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:22692:x1875734060849920:12345-0@lo:104: 10000000:01000000:1.0:1788839997.837703:0:22666:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839997.837707:0:22661:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.837737:0:22666:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.837744:0:22666:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788839997.837767:0:22692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22692:1875734060849920:0@lo:104: 00010000:00010000:1.0:1788839997.837791:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.837799:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e400/0xad5b343a26574809 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574810 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.837817:0:22692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.837824:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839997.837827:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839997.837828:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839997.837843:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060850048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839997.839563:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839997.839661:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060850048 00000100:00100000:2.0:1788839997.839681:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060850048 00010000:00010000:2.0:1788839997.839726:0:22663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26574809 expref: 24 pid: 22669 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839997.839759:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839997.839785:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3617:x1875734060850048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839997.839799:0:22663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839997.839804:0:22663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26574809 expref: 24 pid: 22669 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.839816:0:22663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26574809 expref: 24 pid: 22669 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.839833:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553c00/0xad5b343a26574810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26574809 expref: 24 pid: 22669 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.839848:0:22663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839997.840094:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:3617:x1875734060850048:12345-0@lo:103:ldlm_bl.0 Request processed in 326us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839997.840101:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839997.840423:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060850048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839997.840615:0:22661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839997.840624:0:22661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:22692:x1875734060849920:12345-0@lo:104: Request processed in 2934us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839997.840632:0:22661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00000004:1.0:1788839997.843634:0:24997:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:2.0:1788839997.846057:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839997.846071:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.846084:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553000 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839997.846089:0:22665:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839997.846099:0:22665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839997.846120:0:22665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839997.846126:0:22665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788839997.846294:0:22665:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.846302:0:22665:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839997.846340:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.846348:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a265747fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574802 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.846369:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839997.846370:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839997.846372:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839997.846576:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060850176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839997.846665:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839997.846807:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060850176 00000100:00100000:1.0:1788839997.846816:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060850176 00010000:00010000:1.0:1788839997.846842:0:22664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab746e4e600/0xad5b343a26574802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265747fb expref: 23 pid: 22670 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839997.846872:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788839997.846882:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:3614:x1875734060850176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839997.846903:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839997.846909:0:22664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab746e4e600/0xad5b343a26574802 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265747fb expref: 23 pid: 22670 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.846929:0:22664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab746e4e600/0xad5b343a26574802 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265747fb expref: 23 pid: 22670 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.846943:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab746e4e600/0xad5b343a26574802 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265747fb expref: 23 pid: 22670 timeout: 752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.846957:0:22664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.846964:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788839997.846979:0:22664:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009925750s 00010000:00010000:1.0:1788839997.846984:0:22664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.846991:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.846998:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.847005:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.847010:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788839997.847014:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.847020:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.847039:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839997.847048:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839997.847088:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:3614:x1875734060850176:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839997.847096:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788839997.847132:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060850176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839997.847486:0:22692:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.847495:0:22692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839997.847502:0:22692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab781e69600/0xad5b343a2657488e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788839997.856176:0:24997:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788839997.856185:0:24997:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788839997.856218:0:24997:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788839997.856259:0:24997:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788839997.858798:0:24997:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788839997.858846:0:24997:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788839997.861230:0:24997:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788839997.862528:0:24997:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788839998.629946:0:25063:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839998.630155:0:25063:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839998.719145:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788839999.042738:0:22712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788839999.743218:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788839999.809343:0:22674:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788839999.809351:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab7467ba000 from 14 10000000:01000000:0.0:1788839999.809356:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788839999.809401:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a26574895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839999.809414:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a26574895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839999.809426:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a26574895 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839999.809454:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060850304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839999.809518:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839999.811870:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249540 going to sleep for 11 seconds 00000100:00100000:1.0:1788839999.812199:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060850304 00000100:00100000:1.0:1788839999.812209:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060850304 00000100:00100000:1.0:1788839999.812270:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788839999.812281:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:22674:x1875734060850304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839999.812299:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839999.812317:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab746e4f000/0xad5b343a2657489c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574895 expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839999.812344:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab746e4f000/0xad5b343a2657489c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574895 expref: 23 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839999.812364:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab746e4f000/0xad5b343a2657489c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574895 expref: 23 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839999.812373:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4f000, rc 0) 00000100:00100000:1.0:1788839999.812432:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:22674:x1875734060850304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (2913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839999.812439:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788839999.812547:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060850304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839999.812566:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a26574895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657489c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839999.812575:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a26574895 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657489c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839999.813218:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060850432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788839999.813259:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839999.813283:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249540 going to sleep for 11 seconds 00000100:00100000:1.0:1788839999.813883:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060850432 00000100:00100000:1.0:1788839999.813890:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060850432 00000100:00100000:1.0:1788839999.815051:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788839999.815064:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:22674:x1875734060850432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788839999.816299:0:22669:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788839999.816318:0:22669:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788839999.816322:0:22669:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788839999.816450:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:22674:x1875734060850432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1388us (3189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839999.816459:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788839999.817276:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060850432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788839999.817357:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788839999.817371:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a26574895 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657489c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839999.817382:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab781e68000/0xad5b343a26574895 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657489c expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839999.817394:0:22674:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788839999.817397:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab781e72000 from 14 10000000:01000000:0.0:1788839999.817400:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788839999.817432:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69400/0xad5b343a265748a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839999.817440:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab781e69400/0xad5b343a265748a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839999.817449:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab781e69400/0xad5b343a265748a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839999.817477:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060850560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839999.817520:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839999.818756:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060850560 00000100:00100000:1.0:1788839999.818766:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060850560 00000100:00100000:1.0:1788839999.819015:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788839999.819033:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:22674:x1875734060850560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839999.819049:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839999.819064:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab746e4f200/0xad5b343a265748aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265748a3 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839999.819420:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab746e4f200/0xad5b343a265748aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265748a3 expref: 24 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839999.819443:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab746e4f200/0xad5b343a265748aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265748a3 expref: 24 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839999.819452:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4f200, rc 0) 00000100:00100000:1.0:1788839999.819506:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:22674:x1875734060850560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 482us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839999.819513:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788839999.819625:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249540 going to sleep for 11 seconds 00000100:00100000:0.0:1788839999.819765:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060850560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839999.819979:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab781e69400/0xad5b343a265748a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265748aa expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839999.819990:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab781e69400/0xad5b343a265748a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265748aa expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839999.820053:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060850688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788839999.820869:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839999.821142:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060850688 00000100:00100000:1.0:1788839999.821150:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060850688 00000100:00100000:1.0:1788839999.821189:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788839999.821196:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:22674:x1875734060850688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788839999.821214:0:22672:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788839999.821232:0:22672:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788839999.821234:0:22672:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788839999.821301:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:22674:x1875734060850688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839999.821308:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788839999.821374:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249540 going to sleep for 11 seconds 00000100:00100000:0.0:1788839999.821391:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060850688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788839999.821443:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788839999.821450:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69400/0xad5b343a265748a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265748aa expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839999.821459:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab781e69400/0xad5b343a265748a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265748aa expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840000.383876:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060850816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788840000.383941:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840000.383980:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060850816 00000100:00100000:2.0:1788840000.383988:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060850816 00000100:00100000:2.0:1788840000.384050:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788840000.384059:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060850816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788840000.384124:0:24187:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788840000.384167:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060850816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840000.384173:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788840000.384243:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788840000.384927:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab744357800 x1875734060850816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788840016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788840000.385115:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060850816:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788840000.768299:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788840000.897698:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060850944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788840000.897763:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840000.897824:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788840000.897838:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060851072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788840000.897864:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840000.903128:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060850944 00000100:00100000:2.0:1788840000.903152:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060850944 00000100:00100000:2.0:1788840000.903204:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060851072 00000100:00100000:2.0:1788840000.903207:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060851072 00000100:00100000:2.0:1788840000.903226:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788840000.903234:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060850944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788840000.903270:0:22682:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788840000.903362:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060850944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (5598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840000.903370:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788840000.903388:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788840000.903394:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060851072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788840000.903418:0:22682:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788840000.903448:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060851072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (5582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840000.903499:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788840000.903618:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060851072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788840000.903645:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060850944:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788840001.790977:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788840001.918888:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839981/real 1788839981] req@ffff8ab7443db800 x1875734060836864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788840001 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788840001.918923:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab7443db800 x1875734060836864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788840001 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788840001.918934:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839981/real 1788839981] req@ffff8ab7443d8a80 x1875734060836992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788840001 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788840001.918946:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab7443d8a80 x1875734060836992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788840001 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788840001.918975:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788840001.919014:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788840001.919019:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060836864:0@lo:8:kworker.0 00000100:00080000:3.0:1788840001.919025:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193d800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788840001.919032:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788840001.919036:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060836992:0@lo:8:kworker.0 00000100:00080000:0.0:1788840001.919181:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788840001.919195:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788840001.919199:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab78193b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788840001.919203:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 636 00000100:00080000:0.0:1788840001.919208:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788840001.919214:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab78193b800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788840001.919234:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7766eed80 x1875734060851456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788840001.919248:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788840001.919251:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788840001.919253:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab78193d800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788840001.919255:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 636 00000100:00080000:0.0:1788840001.919257:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788840001.919261:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab78193d800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788840001.919271:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7766ec700 x1875734060851584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788840001.919303:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788840001.919306:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788840001.919307:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788840001.919312:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ab6479d5800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788840001.919322:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7766ee300 x1875734060852096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788840001.919372:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060851328:0@lo:400:kworker.0 00000100:00100000:3.0:1788840001.919521:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060851200:0@lo:400:kworker.0 00000100:00100000:3.0:1788840001.922931:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840001.922979:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060851968:0@lo:400:kworker.0 00000100:00100000:3.0:1788840001.923008:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840001.923026:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060852608:0@lo:400:kworker.0 00000100:00100000:3.0:1788840001.923051:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840001.923086:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060851200 00000100:00100000:3.0:1788840001.923092:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060851200 00000100:00100000:3.0:1788840001.923133:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788840001.923140:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3614:x1875734060851200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788840001.923192:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3614:x1875734060851200:12345-0@lo:400:kworker.0 Request processed in 52us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840001.923199:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788840001.923227:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060851968 00000100:00100000:3.0:1788840001.923230:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060851968 00000100:00100000:3.0:1788840001.923253:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788840001.923259:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060851968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788840001.923284:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060851968:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840001.923289:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788840001.923304:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060852608 00000100:00100000:3.0:1788840001.923307:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060852608 00000100:00100000:3.0:1788840001.923334:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788840001.923339:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060852608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788840001.923364:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060852608:12345-0@lo:400:kworker.0 Request processed in 24us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840001.923369:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788840001.923387:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788840001.923413:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060851200:0@lo:400:kworker.0 00010000:00080000:3.0:1788840001.923425:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766ed180 x1875734060851968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788840017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788840001.923435:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060851968:0@lo:400:kworker.0 00010000:00080000:3.0:1788840001.923443:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476b0e00 x1875734060852608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788840001.923450:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060852608:0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.923551:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.923579:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060852224:0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.923606:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.923622:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060852736:0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.923714:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.923742:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060851712:0@lo:400:kworker.0 00000100:00100000:3.0:1788840001.924747:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060851328 00000100:00100000:3.0:1788840001.924756:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060851328 00000100:00100000:3.0:1788840001.924929:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788840001.924938:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060851328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788840001.924995:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060851328:12345-0@lo:400:kworker.0 Request processed in 59us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840001.925002:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788840001.925063:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.925097:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060852352:0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.925123:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.925145:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788840001.925151:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060851840:0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.925175:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.925194:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060852480:0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.925214:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.925253:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060852224 00000100:00100000:0.0:1788840001.925257:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060852224 00000100:00100000:0.0:1788840001.925277:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060852736 00000100:00100000:0.0:1788840001.925280:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060852736 00000100:00100000:0.0:1788840001.925299:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060851712 00000100:00100000:0.0:1788840001.925301:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060851712 00000100:00100000:0.0:1788840001.925310:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060852352 00000100:00100000:0.0:1788840001.925312:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060852352 00000100:00100000:0.0:1788840001.925322:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060852480 00000100:00100000:0.0:1788840001.925324:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060852480 00000100:00100000:0.0:1788840001.925336:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788840001.925341:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060852224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.925387:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060852224:12345-0@lo:400:kworker.0 Request processed in 45us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.925394:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788840001.925415:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788840001.925421:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060852736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.925448:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060852736:12345-0@lo:400:kworker.0 Request processed in 28us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.925454:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788840001.925465:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788840001.925471:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060851712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.925500:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060851712:12345-0@lo:400:kworker.0 Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.925506:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788840001.925519:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788840001.925524:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060852352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.925549:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060852352:12345-0@lo:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.925555:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788840001.925565:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788840001.925571:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060852480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.925594:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060852480:12345-0@lo:400:kworker.0 Request processed in 24us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.925600:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788840001.925620:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060851840 00000100:00100000:0.0:1788840001.925624:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060851840 00000100:00100000:0.0:1788840001.925728:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788840001.925734:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060851840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840001.925899:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060851840:12345-0@lo:400:kworker.0 Request processed in 164us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.925911:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788840001.925931:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788840001.925935:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788840001.925951:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060851456:0@lo:8:kworker.0 00000100:00100000:0.0:1788840001.925979:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.926007:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060851584:0@lo:8:kworker.0 00000100:00100000:0.0:1788840001.926025:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.926041:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060852096:0@lo:8:kworker.0 00000100:00100000:0.0:1788840001.926060:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.926093:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060851456 00000100:00100000:0.0:1788840001.926097:0:24186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060851456 00000100:00100000:0.0:1788840001.926108:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060851584 00000100:00100000:0.0:1788840001.926110:0:24186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060851584 00000100:00100000:0.0:1788840001.926116:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060852096 00000100:00100000:0.0:1788840001.926118:0:24186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060852096 00000100:00100000:0.0:1788840001.926125:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788840001.926129:0:24186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3613:x1875734060851456:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788840001.926153:0:24186:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 656 last 0 00000020:00000080:0.0:1788840001.926180:0:24186:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a265748b1 00002000:00100000:0.0:1788840001.926193:0:24186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ab77e5cf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788840001.926197:0:24186:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788840001.926200:0:24186:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788840001.926267:0:24186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788840001.926289:0:24186:0:(import.c:65:import_set_state_nolock()) ffff8ab77e5ca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788840001.926327:0:24186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1875734060851456:12345-0@lo:8:kworker.0 Request processed in 195us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.926342:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788840001.926354:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788840001.926358:0:24186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3613:x1875734060851584:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788840001.926372:0:24186:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 656 last 0 00000020:00000080:0.0:1788840001.926387:0:24186:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a265748b8 00002000:00100000:0.0:1788840001.926393:0:24186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ab647518800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788840001.926396:0:24186:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788840001.926398:0:24186:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788840001.926519:0:24186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788840001.926532:0:24186:0:(import.c:65:import_set_state_nolock()) ffff8ab647519800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788840001.926559:0:24186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1875734060851584:12345-0@lo:8:kworker.0 Request processed in 200us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.926565:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788840001.926576:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788840001.926579:0:24186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3613:x1875734060852096:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788840001.926591:0:24186:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 656 last 0 00000020:00000080:0.0:1788840001.926605:0:24186:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a265748bf 00002000:00100000:0.0:1788840001.926610:0:24186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8ab64751b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788840001.926614:0:24186:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788840001.926615:0:24186:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788840001.926944:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060851328:0@lo:400:kworker.0 00010000:00080000:3.0:1788840001.926960:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766eca80 x1875734060852224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788840001.926969:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060852224:0@lo:400:kworker.0 00010000:00080000:3.0:1788840001.926986:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476b1500 x1875734060852736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788840001.926995:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060852736:0@lo:400:kworker.0 00002000:00080000:0.0:1788840001.929893:0:24186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788840001.929926:0:24186:0:(import.c:65:import_set_state_nolock()) ffff8ab64751f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788840001.930000:0:24186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3613:x1875734060852096:12345-0@lo:8:kworker.0 Request processed in 3415us (3935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.930010:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788840001.930071:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766eed80 x1875734060851456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788840026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788840001.930083:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788840001.930091:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788840001.930099:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788840001.930104:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788840001.930106:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788840001.930134:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788840001.930139:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060851456:0@lo:8:kworker.0 00010000:00080000:0.0:1788840001.930154:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766ec700 x1875734060851584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788840026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788840001.930162:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788840001.930166:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788840001.930171:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788840001.930174:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788840001.930176:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788840001.930271:0:22701:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:3.0:1788840001.930292:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22701:1875734060852992:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788840001.930330:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840001.930351:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab76b5cb540 going to sleep for 11 seconds 00000004:00080000:3.0:1788840001.930374:0:22703:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788840001.930386:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22703:1875734060853248:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788840001.930411:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840001.930425:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab76b5cbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788840001.930438:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060852992 00000100:00100000:3.0:1788840001.930443:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060852992 00000100:00100000:3.0:1788840001.930490:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060853248 00000100:00100000:3.0:1788840001.930494:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060853248 00000100:00100000:3.0:1788840001.930509:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788840001.930517:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22701:x1875734060852992:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788840001.930752:0:22700:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788840001.930860:0:22700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 656875088890ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788840001.930866:0:22700:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788840001.932466:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060853120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788840001.932517:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840001.932547:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788840001.932553:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060852864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788840001.932575:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840001.932601:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060853120 00000100:00100000:2.0:1788840001.932606:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060853120 00000100:00100000:2.0:1788840001.932631:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060852864 00000100:00100000:2.0:1788840001.932633:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060852864 00000004:00080000:0.0:1788840001.932698:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788840001.932706:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060851584:0@lo:8:kworker.0 00010000:00080000:0.0:1788840001.932731:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766ee300 x1875734060852096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788840026 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788840001.932746:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788840001.932753:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788840001.932758:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788840001.932761:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788840001.932788:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788840001.932792:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060852096:0@lo:8:kworker.0 00000004:00080000:0.0:1788840001.932929:0:23422:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788840001.932948:0:23422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23422:1875734060853504:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788840001.932974:0:23422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.932990:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249f00 going to sleep for 11 seconds 00000100:00080000:0.0:1788840001.933001:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788840001.933006:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788840001.933015:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060853376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788840001.933037:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840001.933072:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060853376 00000100:00100000:0.0:1788840001.933077:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060853376 00000100:00100000:0.0:1788840001.933103:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788840001.933111:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875734060853120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788840001.933135:0:24188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788840001.933175:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875734060853120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.933182:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788840001.933198:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788840001.933204:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875734060852864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788840001.933214:0:24188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788840001.933239:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875734060852864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.933245:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788840001.933256:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788840001.933261:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3614:x1875734060853376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788840001.933270:0:24188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788840001.933304:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3614:x1875734060853376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840001.933310:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788840001.933322:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788840001.933338:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777cae680 x1875734060853376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788840017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788840001.933352:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060853376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788840001.933378:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060851840:0@lo:400:kworker.0 00010000:00080000:0.0:1788840001.933391:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476b2d80 x1875734060852480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788840001.933401:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060852480:0@lo:400:kworker.0 00010000:00080000:0.0:1788840001.933413:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766ed500 x1875734060851712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788840001.933420:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060851712:0@lo:400:kworker.0 00010000:00080000:0.0:1788840001.933432:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766ec380 x1875734060852352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788840001.933440:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060852352:0@lo:400:kworker.0 00000004:00080000:3.0:1788840001.935249:0:23421:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788840001.935327:0:23421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 656879556336ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788840001.935334:0:23421:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:3.0:1788840001.935448:0:24185:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788840001.935456:0:24185:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788840001.935461:0:24185:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00000100:00100000:2.0:1788840001.939186:0:24183:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000004:00080000:0.0:1788840001.939302:0:22657:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788840001.939492:0:24183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1788840001.939563:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab781a49500 x1875734060852864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788840017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788840001.939590:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060852864:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788840001.939605:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766eca80 x1875734060853120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788840017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788840001.939616:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060853120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788840001.940432:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060853504 00000100:00100000:2.0:1788840001.940439:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060853504 00000004:00080000:1.0:1788840001.940656:0:22702:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788840001.940743:0:22702:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 656884971686ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788840001.940749:0:22702:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788840001.941023:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788840001.941034:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22703:x1875734060853248:12345-0@lo:5:osp-pre-1-0.0 00002000:00010000:3.0:1788840001.952083:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840001.952096:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a265748c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.952112:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840001.952117:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840001.952123:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a265748c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.954040:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a265748c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.954060:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a265748c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.954069:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a265748c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.954100:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788840001.954113:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840001.954119:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a265748c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.954127:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840001.954132:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a265748c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.954141:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a265748c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.954158:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a265748c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.954165:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a265748c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.954182:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.954184:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.954185:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788840001.954692:0:23409:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:0.0:1788840001.959704:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.959719:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a265748cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.959742:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.959747:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.959754:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a265748cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.959793:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a265748cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.959805:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a265748cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.959813:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a265748cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.959836:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788840001.960571:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.960578:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dd690f/0xad5b343a265748d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.960587:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.960591:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.960595:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dd690f/0xad5b343a265748d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.960605:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0dd690f/0xad5b343a265748d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.960638:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0dd690f/0xad5b343a265748d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.960655:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0dd690f/0xad5b343a265748d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.960668:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788840001.963077:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.963089:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a910108/0xad5b343a265748db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.963104:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.963108:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.963114:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a910108/0xad5b343a265748db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.963126:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a910108/0xad5b343a265748db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.963136:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a910108/0xad5b343a265748db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.963142:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a910108/0xad5b343a265748db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.963163:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788840001.967041:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788840001.967055:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a265748cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967069:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840001.967082:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a265748cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967094:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a265748cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967113:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a265748cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967120:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a265748cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967137:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788840001.967142:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0dd690f/0xad5b343a265748d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967147:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840001.967150:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dd690f/0xad5b343a265748d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967157:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0dd690f/0xad5b343a265748d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967166:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0dd690f/0xad5b343a265748d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967172:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0dd690f/0xad5b343a265748d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967191:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840001.967195:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a910108/0xad5b343a265748db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967200:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840001.967203:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a910108/0xad5b343a265748db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967210:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a910108/0xad5b343a265748db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967218:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a910108/0xad5b343a265748db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967224:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a910108/0xad5b343a265748db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.967235:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.967237:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.967238:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.967245:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788840001.967392:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788840001.967399:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd00a8cc/0xad5b343a265748e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.967410:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=656s v=(0 0) 00010000:00010000:1.0:1788840001.967415:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788840001.967420:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd00a8cc/0xad5b343a265748e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.967433:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd00a8cc/0xad5b343a265748e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.967443:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd00a8cc/0xad5b343a265748e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.967450:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd00a8cc/0xad5b343a265748e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.967471:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788840001.968056:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788840001.968064:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006973c135/0xad5b343a265748e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.968083:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=656s v=(0 0) 00010000:00010000:1.0:1788840001.968086:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788840001.968090:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006973c135/0xad5b343a265748e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.968100:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006973c135/0xad5b343a265748e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.968109:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006973c135/0xad5b343a265748e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.968116:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006973c135/0xad5b343a265748e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.968128:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788840001.968377:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788840001.968383:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c85158a/0xad5b343a265748f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.968391:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=656s v=(0 0) 00010000:00010000:1.0:1788840001.968394:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788840001.968398:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c85158a/0xad5b343a265748f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.968407:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c85158a/0xad5b343a265748f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.968426:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000c85158a/0xad5b343a265748f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.968433:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000c85158a/0xad5b343a265748f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.968441:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788840001.968711:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788840001.968717:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd00a8cc/0xad5b343a265748e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968725:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4fe00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840001.968735:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd00a8cc/0xad5b343a265748e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968744:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd00a8cc/0xad5b343a265748e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968784:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd00a8cc/0xad5b343a265748e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968792:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd00a8cc/0xad5b343a265748e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968808:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788840001.968811:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006973c135/0xad5b343a265748e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968818:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4e800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840001.968821:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006973c135/0xad5b343a265748e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968829:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006973c135/0xad5b343a265748e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968839:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006973c135/0xad5b343a265748e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968845:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006973c135/0xad5b343a265748e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968863:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840001.968866:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000c85158a/0xad5b343a265748f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968871:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4f800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840001.968874:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000c85158a/0xad5b343a265748f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968882:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000c85158a/0xad5b343a265748f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968892:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000c85158a/0xad5b343a265748f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968898:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c85158a/0xad5b343a265748f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.968908:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.968910:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.968912:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.968918:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788840001.969057:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788840001.969063:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d78da4e1/0xad5b343a265748f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.969071:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=656s v=(0 0) 00010000:00010000:1.0:1788840001.969074:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788840001.969078:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d78da4e1/0xad5b343a265748f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.969086:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d78da4e1/0xad5b343a265748f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.969094:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d78da4e1/0xad5b343a265748f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.969101:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d78da4e1/0xad5b343a265748f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.969131:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788840001.969346:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840001.969352:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d78da4e1/0xad5b343a265748f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.969358:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4fc00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840001.969367:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d78da4e1/0xad5b343a265748f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.969386:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d78da4e1/0xad5b343a265748f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.969397:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d78da4e1/0xad5b343a265748f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.969404:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d78da4e1/0xad5b343a265748f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.969417:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.969419:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.969420:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788840001.969909:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788840001.969915:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091f582b/0xad5b343a265748fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.969924:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=656s v=(0 0) 00010000:00010000:1.0:1788840001.969927:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788840001.969931:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000091f582b/0xad5b343a265748fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.969940:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000091f582b/0xad5b343a265748fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.969948:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000091f582b/0xad5b343a265748fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.969954:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000091f582b/0xad5b343a265748fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.970005:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788840001.970734:0:25205:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788840001.970742:0:25205:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:0.0:1788840001.970748:0:25205:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:65) 00002000:00010000:1.0:1788840001.975540:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788840001.975553:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574905 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.975570:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=656s v=(0 0) 00010000:00010000:1.0:1788840001.975582:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788840001.975589:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.975605:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.975616:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574905 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.975623:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574905 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.975728:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788840001.975736:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000091f582b/0xad5b343a265748fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.975745:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4fa00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840001.975750:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000091f582b/0xad5b343a265748fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.975783:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000091f582b/0xad5b343a265748fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.975801:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000091f582b/0xad5b343a265748fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.975815:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000091f582b/0xad5b343a265748fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.975830:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840001.975833:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574905 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.975840:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4f400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840001.975843:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574905 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.975850:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574905 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.975859:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574905 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.975866:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.975868:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.975869:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788840001.975882:0:22657:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788840001.982145:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.982155:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014aaf2ab/0xad5b343a2657490c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.982172:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.982177:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.982183:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014aaf2ab/0xad5b343a2657490c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.982199:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014aaf2ab/0xad5b343a2657490c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.982208:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014aaf2ab/0xad5b343a2657490c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.982216:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014aaf2ab/0xad5b343a2657490c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.982239:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788840001.982614:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840001.982621:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014aaf2ab/0xad5b343a2657490c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.982691:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840001.982704:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014aaf2ab/0xad5b343a2657490c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.982713:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014aaf2ab/0xad5b343a2657490c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.982731:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014aaf2ab/0xad5b343a2657490c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.982738:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014aaf2ab/0xad5b343a2657490c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.982832:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.982835:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840001.982837:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840001.983125:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788840001.983132:0:24185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574905 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.984056:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840001.985707:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840001.985719:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a26574913 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.985734:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840001.985738:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840001.985744:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a26574913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.985874:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a26574913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.985902:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a26574913 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.985910:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a26574913 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788840001.986154:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.986160:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b198c1af/0xad5b343a2657491a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.986173:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.986176:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.986180:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b198c1af/0xad5b343a2657491a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.986190:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b198c1af/0xad5b343a2657491a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.986198:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b198c1af/0xad5b343a2657491a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.986205:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b198c1af/0xad5b343a2657491a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.986231:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788840001.988962:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840001.988975:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a26574921 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.988993:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840001.988998:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840001.989005:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a26574921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.989019:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a26574921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.989028:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a26574921 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840001.989037:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a26574921 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993137:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788840001.993152:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a26574913 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993167:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840001.993171:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a26574913 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993182:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a26574913 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993216:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a26574913 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993224:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f427589d/0xad5b343a26574913 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993245:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788840001.993249:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b198c1af/0xad5b343a2657491a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993256:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc22a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840001.993260:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b198c1af/0xad5b343a2657491a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993268:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b198c1af/0xad5b343a2657491a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993281:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b198c1af/0xad5b343a2657491a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993288:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788840001.993291:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a26574921 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993296:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840001.993305:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a26574921 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993313:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a26574921 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993324:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a26574921 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.993331:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840001.993333:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840001.993334:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788840001.993620:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788840001.993638:0:25205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b198c1af/0xad5b343a2657491a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.994226:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788840001.994364:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.994370:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ce079a/0xad5b343a26574928 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.994382:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.994386:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.994403:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080ce079a/0xad5b343a26574928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.994426:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080ce079a/0xad5b343a26574928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.994435:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080ce079a/0xad5b343a26574928 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.994443:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080ce079a/0xad5b343a26574928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.994462:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788840001.994738:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788840001.994743:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080ce079a/0xad5b343a26574928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.994752:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc23a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840001.994764:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ce079a/0xad5b343a26574928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.994789:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080ce079a/0xad5b343a26574928 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.994801:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080ce079a/0xad5b343a26574928 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.994808:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080ce079a/0xad5b343a26574928 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.994830:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840001.994831:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840001.994833:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788840001.994962:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.994967:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc3f712/0xad5b343a2657492f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.994976:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.994979:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.994983:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc3f712/0xad5b343a2657492f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.994991:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcc3f712/0xad5b343a2657492f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.994999:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc3f712/0xad5b343a2657492f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.995018:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc3f712/0xad5b343a2657492f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.995037:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788840001.995256:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788840001.995262:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcc3f712/0xad5b343a2657492f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.995269:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc23e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840001.995272:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc3f712/0xad5b343a2657492f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.995280:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc3f712/0xad5b343a2657492f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.995291:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcc3f712/0xad5b343a2657492f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.995297:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc3f712/0xad5b343a2657492f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.995309:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840001.995311:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840001.995313:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788840001.995377:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.995382:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bd91ae0/0xad5b343a26574936 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.995456:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.995460:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.995464:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bd91ae0/0xad5b343a26574936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.995473:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bd91ae0/0xad5b343a26574936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.995480:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bd91ae0/0xad5b343a26574936 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.995486:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bd91ae0/0xad5b343a26574936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.995505:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788840001.995743:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788840001.995748:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bd91ae0/0xad5b343a26574936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.995794:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc22800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840001.995798:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bd91ae0/0xad5b343a26574936 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.995806:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bd91ae0/0xad5b343a26574936 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.995817:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bd91ae0/0xad5b343a26574936 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.995824:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bd91ae0/0xad5b343a26574936 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.995839:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840001.995840:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840001.995842:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788840001.995975:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.995982:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ae4f86d/0xad5b343a2657493d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.995996:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.996000:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.996004:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ae4f86d/0xad5b343a2657493d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.996013:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ae4f86d/0xad5b343a2657493d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.996020:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ae4f86d/0xad5b343a2657493d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.996028:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ae4f86d/0xad5b343a2657493d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.996048:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788840001.996304:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.996310:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aabb79fc/0xad5b343a26574944 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.996319:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.996322:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.996326:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aabb79fc/0xad5b343a26574944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.996335:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aabb79fc/0xad5b343a26574944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.996354:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aabb79fc/0xad5b343a26574944 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.996361:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aabb79fc/0xad5b343a26574944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.996375:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788840001.998901:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.998923:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068743718/0xad5b343a2657494b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.998938:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.998942:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.998948:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068743718/0xad5b343a2657494b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.998960:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068743718/0xad5b343a2657494b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.998969:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068743718/0xad5b343a2657494b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.998978:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068743718/0xad5b343a2657494b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.999001:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788840001.999247:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788840001.999255:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ae4f86d/0xad5b343a2657493d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999264:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc23800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840001.999268:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ae4f86d/0xad5b343a2657493d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999278:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ae4f86d/0xad5b343a2657493d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999304:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ae4f86d/0xad5b343a2657493d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999323:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ae4f86d/0xad5b343a2657493d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999343:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788840001.999347:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aabb79fc/0xad5b343a26574944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999354:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc23c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840001.999357:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aabb79fc/0xad5b343a26574944 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999365:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aabb79fc/0xad5b343a26574944 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999375:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aabb79fc/0xad5b343a26574944 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999382:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aabb79fc/0xad5b343a26574944 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999532:0:22665:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788840001.999536:0:22665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068743718/0xad5b343a2657494b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999550:0:22665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc23600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840001.999553:0:22665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068743718/0xad5b343a2657494b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999561:0:22665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068743718/0xad5b343a2657494b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999571:0:22665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068743718/0xad5b343a2657494b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840001.999578:0:22665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068743718/0xad5b343a2657494b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788840001.999672:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840001.999678:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000291aee3a/0xad5b343a26574952 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.999687:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840001.999690:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840001.999694:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000291aee3a/0xad5b343a26574952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.999703:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000291aee3a/0xad5b343a26574952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.999711:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000291aee3a/0xad5b343a26574952 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.999718:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000291aee3a/0xad5b343a26574952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840001.999728:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788840002.001110:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788840002.001119:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d21ab6f7/0xad5b343a26574959 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840002.001131:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=656s v=(0 0) 00010000:00010000:0.0:1788840002.001140:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840002.001146:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d21ab6f7/0xad5b343a26574959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840002.001156:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d21ab6f7/0xad5b343a26574959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840002.001163:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d21ab6f7/0xad5b343a26574959 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840002.001170:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d21ab6f7/0xad5b343a26574959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840002.001179:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788840002.001612:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788840002.001619:0:24185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a26574921 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788840002.002574:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788840002.002589:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574960 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.002600:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1788840002.002604:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788840002.002608:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.002621:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.003453:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574960 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.003463:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.003473:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1788840002.004449:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.004459:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ab582bf/0xad5b343a26574967 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.004470:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.004474:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.004479:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ab582bf/0xad5b343a26574967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.004490:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ab582bf/0xad5b343a26574967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.004498:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ab582bf/0xad5b343a26574967 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.004506:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ab582bf/0xad5b343a26574967 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.004515:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1788840002.005044:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.005050:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000436dcd06/0xad5b343a2657496e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.005064:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.005067:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.005071:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000436dcd06/0xad5b343a2657496e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.005080:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000436dcd06/0xad5b343a2657496e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.005087:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000436dcd06/0xad5b343a2657496e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.005094:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000436dcd06/0xad5b343a2657496e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.005103:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1788840002.005330:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.005336:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093106eb9/0xad5b343a26574975 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.005344:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.005347:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.005351:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093106eb9/0xad5b343a26574975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.005360:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093106eb9/0xad5b343a26574975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.005378:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093106eb9/0xad5b343a26574975 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.005386:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093106eb9/0xad5b343a26574975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.006035:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1788840002.006188:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.006195:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944d1ea4/0xad5b343a2657497c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.006205:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.006209:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.006214:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944d1ea4/0xad5b343a2657497c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.006223:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000944d1ea4/0xad5b343a2657497c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.006232:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944d1ea4/0xad5b343a2657497c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.006240:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000944d1ea4/0xad5b343a2657497c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.006260:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788840002.006658:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00002000:00010000:3.0:1788840002.008551:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.008560:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a910108/0xad5b343a26574983 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.008576:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.008580:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.008585:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a910108/0xad5b343a26574983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.008598:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a910108/0xad5b343a26574983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.008607:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a910108/0xad5b343a26574983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.008615:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a910108/0xad5b343a26574983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.008626:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:2.0:1788840002.008863:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788840002.008874:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000291aee3a/0xad5b343a26574952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.008882:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc22600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.008886:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000291aee3a/0xad5b343a26574952 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.008907:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000291aee3a/0xad5b343a26574952 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.008925:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000291aee3a/0xad5b343a26574952 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.008933:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000291aee3a/0xad5b343a26574952 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.008955:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788840002.008960:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.008967:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.008971:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574960 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.008978:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574960 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.008988:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574960 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.008995:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574960 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009020:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788840002.009025:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ab582bf/0xad5b343a26574967 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009032:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.009035:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab582bf/0xad5b343a26574967 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009043:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ab582bf/0xad5b343a26574967 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009057:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ab582bf/0xad5b343a26574967 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009063:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ab582bf/0xad5b343a26574967 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009079:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788840002.009082:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000436dcd06/0xad5b343a2657496e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009088:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.009091:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000436dcd06/0xad5b343a2657496e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009111:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000436dcd06/0xad5b343a2657496e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009121:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000436dcd06/0xad5b343a2657496e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009128:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000436dcd06/0xad5b343a2657496e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009142:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788840002.009145:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093106eb9/0xad5b343a26574975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009151:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.009154:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093106eb9/0xad5b343a26574975 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009161:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093106eb9/0xad5b343a26574975 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009171:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093106eb9/0xad5b343a26574975 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009178:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093106eb9/0xad5b343a26574975 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009202:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788840002.009206:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000944d1ea4/0xad5b343a2657497c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009213:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.009216:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000944d1ea4/0xad5b343a2657497c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009223:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000944d1ea4/0xad5b343a2657497c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009233:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000944d1ea4/0xad5b343a2657497c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009240:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000944d1ea4/0xad5b343a2657497c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009252:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788840002.009255:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a910108/0xad5b343a26574983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009261:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.009264:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a910108/0xad5b343a26574983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009280:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a910108/0xad5b343a26574983 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009288:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a910108/0xad5b343a26574983 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009295:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a910108/0xad5b343a26574983 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.009306:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.009307:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.009308:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.010102:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.010111:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0dd690f/0xad5b343a2657498a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.010121:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.010130:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.010136:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0dd690f/0xad5b343a2657498a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.010145:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0dd690f/0xad5b343a2657498a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.010154:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0dd690f/0xad5b343a2657498a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.010161:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0dd690f/0xad5b343a2657498a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.010178:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788840002.010337:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.010343:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a26574991 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.010352:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.010355:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.010359:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a26574991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.010368:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a26574991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.010376:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a26574991 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.010387:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a26574991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.010475:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788840002.010480:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0dd690f/0xad5b343a2657498a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.010488:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.010491:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0dd690f/0xad5b343a2657498a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.010500:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0dd690f/0xad5b343a2657498a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.010511:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0dd690f/0xad5b343a2657498a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.010669:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0dd690f/0xad5b343a2657498a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.011477:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.011480:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.011482:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.011939:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.011946:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d21ab6f7/0xad5b343a26574959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.011956:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc22400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.011960:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d21ab6f7/0xad5b343a26574959 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.011969:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d21ab6f7/0xad5b343a26574959 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.011983:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d21ab6f7/0xad5b343a26574959 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.011990:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d21ab6f7/0xad5b343a26574959 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.012010:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.012011:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.012013:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.012023:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.012025:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.012079:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.012082:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.012083:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788840002.012371:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788840002.012377:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574998 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.012386:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1788840002.012400:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788840002.012405:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574998 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.012415:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574998 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.012423:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574998 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.012431:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574998 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.012456:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788840002.014705:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.014717:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037043b33/0xad5b343a2657499f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.014732:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.014735:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.014740:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037043b33/0xad5b343a2657499f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.014753:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037043b33/0xad5b343a2657499f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.014791:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037043b33/0xad5b343a2657499f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.014800:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037043b33/0xad5b343a2657499f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018041:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788840002.018055:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a26574991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018069:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840002.018074:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a26574991 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018086:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a26574991 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018116:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a26574991 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018124:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094dfd274/0xad5b343a26574991 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018144:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788840002.018149:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574998 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018156:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840002.018159:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574998 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018167:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574998 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018177:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574998 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018184:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788840002.018188:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037043b33/0xad5b343a2657499f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018194:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840002.018203:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037043b33/0xad5b343a2657499f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018211:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037043b33/0xad5b343a2657499f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018220:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037043b33/0xad5b343a2657499f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.018228:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.018230:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.018231:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.018336:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788840002.018343:0:25205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574998 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.018382:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.018508:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788840002.018514:0:24185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037043b33/0xad5b343a2657499f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788840002.020236:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.020247:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cd3fbc9/0xad5b343a265749a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.020262:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.020267:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.020273:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cd3fbc9/0xad5b343a265749a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.020285:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cd3fbc9/0xad5b343a265749a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.020293:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cd3fbc9/0xad5b343a265749a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.020313:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cd3fbc9/0xad5b343a265749a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.023523:0:25213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788840002.023538:0:25213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cd3fbc9/0xad5b343a265749a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.023566:0:25213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.023572:0:25213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cd3fbc9/0xad5b343a265749a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.023583:0:25213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cd3fbc9/0xad5b343a265749a6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.023604:0:25213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cd3fbc9/0xad5b343a265749a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.023613:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.023615:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.023617:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788840002.029048:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788840002.029059:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dbfc7bb/0xad5b343a265749ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.029076:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1788840002.029081:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788840002.029088:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dbfc7bb/0xad5b343a265749ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.029101:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dbfc7bb/0xad5b343a265749ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.029111:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dbfc7bb/0xad5b343a265749ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.029126:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dbfc7bb/0xad5b343a265749ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.029191:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788840002.029863:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788840002.029869:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051be4c0c/0xad5b343a265749b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.029879:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1788840002.029882:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788840002.029887:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051be4c0c/0xad5b343a265749b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.029896:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051be4c0c/0xad5b343a265749b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.029904:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051be4c0c/0xad5b343a265749b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.029910:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051be4c0c/0xad5b343a265749b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.029926:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788840002.030333:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788840002.030341:0:24185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cd3fbc9/0xad5b343a265749a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.030369:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788840002.030375:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dbfc7bb/0xad5b343a265749ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.030394:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.030399:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dbfc7bb/0xad5b343a265749ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.030407:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dbfc7bb/0xad5b343a265749ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.030424:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dbfc7bb/0xad5b343a265749ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.030431:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dbfc7bb/0xad5b343a265749ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.030444:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840002.030447:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051be4c0c/0xad5b343a265749b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.030454:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.030458:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051be4c0c/0xad5b343a265749b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.030465:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051be4c0c/0xad5b343a265749b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.030476:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051be4c0c/0xad5b343a265749b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.030489:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051be4c0c/0xad5b343a265749b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.030502:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.030504:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.030505:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788840002.031039:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788840002.031045:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265749bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.031059:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1788840002.031062:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788840002.031066:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265749bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.031075:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265749bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.031082:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265749bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.031089:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265749bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.031102:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788840002.031368:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.031374:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265749c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031382:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.031386:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.031390:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265749c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031400:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265749c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031408:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265749c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031414:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265749c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031428:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788840002.031436:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788840002.031446:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265749bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031453:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.031456:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265749bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031464:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265749bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031475:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265749bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031482:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265749bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031496:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840002.031500:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265749c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031506:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.031509:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265749c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031516:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265749c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031538:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265749c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031545:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265749c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.031558:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.031560:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.031562:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.032041:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.032047:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa6dbac/0xad5b343a265749c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.032056:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.032059:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.032063:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fa6dbac/0xad5b343a265749c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.032071:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fa6dbac/0xad5b343a265749c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.032079:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa6dbac/0xad5b343a265749c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.032086:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fa6dbac/0xad5b343a265749c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.032110:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788840002.032117:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840002.032121:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fa6dbac/0xad5b343a265749c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.032127:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.032130:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa6dbac/0xad5b343a265749c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.032138:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa6dbac/0xad5b343a265749c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.032149:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fa6dbac/0xad5b343a265749c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.032156:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fa6dbac/0xad5b343a265749c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.032169:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.032171:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.032172:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788840002.032498:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788840002.032504:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc5e6754/0xad5b343a265749d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.032512:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1788840002.032516:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788840002.032520:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5e6754/0xad5b343a265749d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.032530:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc5e6754/0xad5b343a265749d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.032549:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc5e6754/0xad5b343a265749d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.032556:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5e6754/0xad5b343a265749d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.032575:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788840002.036052:0:25213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788840002.036067:0:25213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc5e6754/0xad5b343a265749d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.036081:0:25213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.036087:0:25213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc5e6754/0xad5b343a265749d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.036098:0:25213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc5e6754/0xad5b343a265749d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.036119:0:25213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc5e6754/0xad5b343a265749d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.036128:0:25213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc5e6754/0xad5b343a265749d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.036154:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.036163:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.036165:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.036257:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.036354:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.036362:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a265749d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.036385:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.036390:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.036396:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a265749d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.036410:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a265749d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.036419:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a265749d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.036426:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a265749d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.036448:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788840002.036755:0:25213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788840002.037155:0:25213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a265749d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.037165:0:25213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.037169:0:25213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a265749d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.037177:0:25213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a265749d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.037190:0:25213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a265749d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.037197:0:25213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a265749d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.037279:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.037282:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.037283:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788840002.037427:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788840002.037433:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c1506e/0xad5b343a265749de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.037442:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1788840002.037445:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788840002.037450:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078c1506e/0xad5b343a265749de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.037473:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078c1506e/0xad5b343a265749de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.037480:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078c1506e/0xad5b343a265749de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.037487:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078c1506e/0xad5b343a265749de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.037504:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788840002.037650:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840002.037656:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078c1506e/0xad5b343a265749de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.037664:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.037667:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c1506e/0xad5b343a265749de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.037755:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078c1506e/0xad5b343a265749de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.037960:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078c1506e/0xad5b343a265749de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.037967:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078c1506e/0xad5b343a265749de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.037983:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.037985:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.037986:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.038266:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.038272:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a265749e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.038281:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.038284:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.038288:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a265749e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.038297:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a265749e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.038737:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a265749e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.038752:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a265749e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.038845:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788840002.039891:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788840002.039900:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086c1caa4/0xad5b343a265749ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.039913:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1788840002.039917:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788840002.039922:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086c1caa4/0xad5b343a265749ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.039933:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086c1caa4/0xad5b343a265749ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.039942:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086c1caa4/0xad5b343a265749ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.039963:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086c1caa4/0xad5b343a265749ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.039985:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788840002.040268:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788840002.040275:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a265749e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040283:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.040287:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a265749e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040297:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a265749e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040323:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a265749e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040331:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a265749e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040348:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840002.040352:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086c1caa4/0xad5b343a265749ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040371:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.040374:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c1caa4/0xad5b343a265749ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040382:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086c1caa4/0xad5b343a265749ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040393:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086c1caa4/0xad5b343a265749ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040401:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086c1caa4/0xad5b343a265749ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040417:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.040419:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.040421:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.040427:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.040477:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.040482:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a265749f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040491:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.040495:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.040499:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a265749f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040519:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a265749f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040528:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a265749f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040535:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a265749f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040551:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788840002.040558:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840002.040562:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a265749f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040568:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.040571:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a265749f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040578:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a265749f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040588:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a265749f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040596:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a265749f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.040616:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.040618:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.040620:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.041503:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.041511:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788840002.042062:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788840002.042071:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e541f0ea/0xad5b343a265749fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.042084:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1788840002.042087:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788840002.042092:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e541f0ea/0xad5b343a265749fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.042102:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e541f0ea/0xad5b343a265749fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.042109:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e541f0ea/0xad5b343a265749fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.042116:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e541f0ea/0xad5b343a265749fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788840002.044021:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.044034:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.044050:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.044055:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.044061:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.044074:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.044084:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.044092:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.044145:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788840002.046377:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788840002.046389:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68e0d30/0xad5b343a26574a08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.046413:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=656s v=(0 0) 00010000:00010000:2.0:1788840002.046418:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788840002.046424:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a68e0d30/0xad5b343a26574a08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.046436:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a68e0d30/0xad5b343a26574a08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.046445:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a68e0d30/0xad5b343a26574a08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.046454:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a68e0d30/0xad5b343a26574a08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046512:0:25213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788840002.046520:0:25213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e541f0ea/0xad5b343a265749fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046529:0:25213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840002.046533:0:25213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e541f0ea/0xad5b343a265749fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046541:0:25213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e541f0ea/0xad5b343a265749fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046558:0:25213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e541f0ea/0xad5b343a265749fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046577:0:25213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e541f0ea/0xad5b343a265749fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046597:0:25213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788840002.046601:0:25213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046608:0:25213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840002.046611:0:25213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046619:0:25213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a01 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046648:0:25213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a01 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046657:0:25213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788840002.046660:0:25213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a68e0d30/0xad5b343a26574a08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046667:0:25213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840002.046671:0:25213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a68e0d30/0xad5b343a26574a08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046698:0:25213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a68e0d30/0xad5b343a26574a08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046709:0:25213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a68e0d30/0xad5b343a26574a08 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.046717:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.046719:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.046721:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.049026:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788840002.049038:0:25205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.049801:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.051657:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.051675:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a26574a0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.051699:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.051703:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.051709:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a26574a0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.051724:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a26574a0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.051735:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a26574a0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.051743:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a26574a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.051900:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788840002.053918:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.053931:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a26574a16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.053946:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.053950:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.053955:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a26574a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.053968:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a26574a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.053986:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a26574a16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.053994:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a26574a16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.054014:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788840002.054024:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788840002.054030:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a26574a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.054038:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.054042:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a26574a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.054052:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a26574a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.054068:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a26574a0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.054074:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d54241b/0xad5b343a26574a0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.054090:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840002.054099:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a26574a16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.054106:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.054109:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a26574a16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.054116:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a26574a16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.054126:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a26574a16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.054133:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f38a5fb0/0xad5b343a26574a16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.054145:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.054147:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.054148:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.055480:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.055490:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26574a1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.055505:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.055509:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.055513:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26574a1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.055537:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26574a1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.055545:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26574a1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.055551:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26574a1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.055568:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788840002.056061:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788840002.056068:0:24185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a68e0d30/0xad5b343a26574a08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788840002.056172:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.056178:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be83c9f1/0xad5b343a26574a24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.056186:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=656s v=(0 0) 00010000:00010000:3.0:1788840002.056188:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.056192:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be83c9f1/0xad5b343a26574a24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.056200:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be83c9f1/0xad5b343a26574a24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.056208:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be83c9f1/0xad5b343a26574a24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.056226:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be83c9f1/0xad5b343a26574a24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.056275:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788840002.061426:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788840002.061441:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26574a1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.061456:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.061462:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26574a1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.061485:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26574a1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.061506:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26574a1d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.061513:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26574a1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.061535:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788840002.061539:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be83c9f1/0xad5b343a26574a24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.061545:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.061548:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be83c9f1/0xad5b343a26574a24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.061555:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be83c9f1/0xad5b343a26574a24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.061565:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be83c9f1/0xad5b343a26574a24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.061572:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be83c9f1/0xad5b343a26574a24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.061597:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.061598:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.061600:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.061839:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.062110:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.062118:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.062129:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1788840002.062133:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.062139:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.062154:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.062164:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.062171:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.062186:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788840002.063479:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.063496:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26574a32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.063508:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1788840002.063512:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.063516:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26574a32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.063527:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26574a32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.063535:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26574a32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.063542:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26574a32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.063556:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788840002.064146:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.064153:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26574a39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.064162:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1788840002.064165:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.064170:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26574a39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.064178:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26574a39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.064193:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26574a39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.064200:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26574a39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.064218:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788840002.065005:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788840002.065013:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065023:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.065027:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065036:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065051:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065059:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048eaad3f/0xad5b343a26574a2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065077:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788840002.065080:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26574a32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065087:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.065099:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26574a32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065108:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26574a32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065119:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26574a32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065125:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26574a32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065136:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788840002.065139:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26574a39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065145:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.065147:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26574a39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065154:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26574a39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065162:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26574a39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065168:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26574a39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.065187:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.065189:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840002.065191:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.065367:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.065374:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4fec0a9/0xad5b343a26574a40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065383:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1788840002.065386:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.065390:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4fec0a9/0xad5b343a26574a40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065400:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4fec0a9/0xad5b343a26574a40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065408:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4fec0a9/0xad5b343a26574a40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065414:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4fec0a9/0xad5b343a26574a40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065479:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788840002.065634:0:25213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840002.065647:0:25213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4fec0a9/0xad5b343a26574a40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065655:0:25213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.065659:0:25213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4fec0a9/0xad5b343a26574a40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065667:0:25213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4fec0a9/0xad5b343a26574a40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065678:0:25213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4fec0a9/0xad5b343a26574a40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065695:0:25213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4fec0a9/0xad5b343a26574a40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065709:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.065711:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.065713:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.065841:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.065848:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ac32f8/0xad5b343a26574a47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065856:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1788840002.065865:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.065870:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040ac32f8/0xad5b343a26574a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065882:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040ac32f8/0xad5b343a26574a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065890:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040ac32f8/0xad5b343a26574a47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065898:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040ac32f8/0xad5b343a26574a47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.065913:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788840002.066018:0:25213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840002.066023:0:25213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040ac32f8/0xad5b343a26574a47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.066030:0:25213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.066034:0:25213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ac32f8/0xad5b343a26574a47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.066042:0:25213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040ac32f8/0xad5b343a26574a47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.066054:0:25213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040ac32f8/0xad5b343a26574a47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.066074:0:25213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040ac32f8/0xad5b343a26574a47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.066087:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.066089:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.066090:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.068616:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.068627:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.071086:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.071100:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574a4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.071118:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1788840002.071123:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.071130:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574a4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.071143:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574a4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.071152:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574a4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.071160:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574a4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.071177:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788840002.071367:0:25213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788840002.071378:0:25213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574a4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.071387:0:25213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840002.071392:0:25213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574a4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.071402:0:25213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574a4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.071420:0:25213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574a4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.071428:0:25213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574a4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.071446:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.071448:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.071450:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788840002.071552:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788840002.071558:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574a55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.071566:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788840002.071569:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788840002.071573:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.071583:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.071591:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574a55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.071609:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.071631:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788840002.072506:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788840002.072513:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af44cc83/0xad5b343a26574a5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.072534:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788840002.072538:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788840002.072542:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af44cc83/0xad5b343a26574a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.072552:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af44cc83/0xad5b343a26574a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.072561:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af44cc83/0xad5b343a26574a5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.072569:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af44cc83/0xad5b343a26574a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.072584:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788840002.072592:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788840002.072596:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.072610:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4f400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840002.072613:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574a55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.072621:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574a55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.072652:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574a55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.072659:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbff1be6/0xad5b343a26574a55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.072673:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788840002.072677:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af44cc83/0xad5b343a26574a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.073676:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.073792:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4e000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840002.073797:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af44cc83/0xad5b343a26574a5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.073807:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af44cc83/0xad5b343a26574a5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.073821:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af44cc83/0xad5b343a26574a5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.073835:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af44cc83/0xad5b343a26574a5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.073852:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.073854:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.073856:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788840002.074163:0:25205:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788840002.074170:0:25205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574a63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.074179:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1788840002.074183:0:25205:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840002.074188:0:25205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.074212:0:25205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.074221:0:25205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574a63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.074228:0:25205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.074244:0:25205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788840002.074907:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788840002.074913:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f3589f/0xad5b343a26574a6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.074922:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788840002.074926:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788840002.074930:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026f3589f/0xad5b343a26574a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.074941:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026f3589f/0xad5b343a26574a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.074949:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026f3589f/0xad5b343a26574a6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.074956:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026f3589f/0xad5b343a26574a6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.074969:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1788840002.077014:0:25205:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:3.0:1788840002.077109:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22703:x1875734060853248:12345-0@lo:5:osp-pre-1-0.0 Request processed in 136074us (146693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840002.077120:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788840002.077180:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22703:1875734060853248:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788840002.077195:0:22703:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788840002.077237:0:22703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22703:1875734060853632:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788840002.077268:0:22703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840002.077293:0:22703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647af23c0 going to sleep for 11 seconds 00002000:00010000:1.0:1788840002.077500:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788840002.077513:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b68fc959/0xad5b343a26574a71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077527:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788840002.077531:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788840002.077538:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b68fc959/0xad5b343a26574a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077550:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b68fc959/0xad5b343a26574a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077559:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b68fc959/0xad5b343a26574a71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077566:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b68fc959/0xad5b343a26574a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077582:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788840002.077592:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788840002.077598:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077605:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840002.077609:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574a63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077618:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574a63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077660:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574a63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077668:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574a63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077917:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788840002.077922:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026f3589f/0xad5b343a26574a6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077930:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4ec00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840002.077933:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f3589f/0xad5b343a26574a6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077942:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026f3589f/0xad5b343a26574a6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077954:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026f3589f/0xad5b343a26574a6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077961:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026f3589f/0xad5b343a26574a6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077974:0:25212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788840002.077978:0:25212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b68fc959/0xad5b343a26574a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.077992:0:25212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4e600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840002.077995:0:25212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b68fc959/0xad5b343a26574a71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.078003:0:25212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b68fc959/0xad5b343a26574a71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.078014:0:25212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b68fc959/0xad5b343a26574a71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.078021:0:25212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b68fc959/0xad5b343a26574a71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.078034:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.078036:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840002.078038:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788840002.080371:0:24185:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788840002.080383:0:24185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000387fac/0xad5b343a26574a78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.080399:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1788840002.080404:0:24185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788840002.080410:0:24185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000387fac/0xad5b343a26574a78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.080423:0:24185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000387fac/0xad5b343a26574a78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.080442:0:24185:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000387fac/0xad5b343a26574a78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.080452:0:24185:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000387fac/0xad5b343a26574a78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840002.080464:0:24185:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788840002.080524:0:24185:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:1.0:1788840002.080611:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22701:x1875734060852992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 150092us (150278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840002.080620:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788840002.080695:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22701:1875734060852992:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788840002.080710:0:22701:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:1.0:1788840002.080750:0:22701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22701:1875734060853760:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788840002.080811:0:22701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840002.080835:0:22701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746ddc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788840002.080851:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060853632 00000100:00100000:1.0:1788840002.080857:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060853632 00000100:00100000:1.0:1788840002.080882:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060853760 00000100:00100000:1.0:1788840002.080885:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060853760 00000100:00100000:1.0:1788840002.080901:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788840002.080910:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23422:x1875734060853504:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:1.0:1788840002.082553:0:24185:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788840002.082560:0:24185:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788840002.082837:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23422:x1875734060853504:12345-0@lo:7:osp-pre-1-1.0 Request processed in 1926us (149859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840002.082846:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788840002.082874:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788840002.082884:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22703:x1875734060853632:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788840002.082917:0:24185:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:0.0:1788840002.083786:0:23422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23422:1875734060853504:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788840002.083800:0:23422:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788840002.083835:0:23422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23422:1875734060853888:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788840002.083873:0:23422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840002.083890:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c33c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788840002.089887:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788840002.089900:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000387fac/0xad5b343a26574a78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.089915:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4e400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840002.089920:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000387fac/0xad5b343a26574a78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.089930:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000387fac/0xad5b343a26574a78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.089950:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000387fac/0xad5b343a26574a78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840002.089958:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000387fac/0xad5b343a26574a78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840002.092099:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.092114:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788840002.093737:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060853888 00000100:00100000:2.0:1788840002.093750:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060853888 00000100:00100000:2.0:1788840002.093819:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788840002.093831:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22701:x1875734060853760:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788840002.093875:0:24183:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:3.0:1788840002.095735:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.095741:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840002.095743:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788840002.118999:0:24180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1788840002.119042:0:24180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788840002.121896:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22701:x1875734060853760:12345-0@lo:5:osp-pre-0-0.0 Request processed in 28059us (41075us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788840002.121910:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788840002.121941:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788840002.121953:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23422:x1875734060853888:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788840002.121983:0:24183:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788840002.122024:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23422:x1875734060853888:12345-0@lo:5:osp-pre-1-1.0 Request processed in 76us (38151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840002.122029:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788840002.122232:0:23422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23422:1875734060853888:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788840002.122247:0:23422:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788840002.122287:0:23422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23422:1875734060854016:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788840002.122571:0:22701:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788840002.122585:0:22701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22701:1875734060853760:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788840002.122595:0:22701:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:0.0:1788840002.122916:0:23422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840002.122947:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788840002.123392:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060854016 00000100:00100000:1.0:1788840002.123399:0:24186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060854016 00000100:00100000:1.0:1788840002.123439:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788840002.123448:0:24186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23422:x1875734060854016:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788840002.123479:0:24186:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000001:00080000:3.0:1788840002.130579:0:24998:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788840002.130638:0:24998:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788840002.130652:0:24998:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788840002.130927:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22703:x1875734060853632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 48041us (53654us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788840002.130938:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788840002.131087:0:22703:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788840002.131096:0:22703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22703:1875734060853632:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788840002.131122:0:22703:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:1.0:1788840002.175540:0:24186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23422:x1875734060854016:12345-0@lo:5:osp-pre-1-1.0 Request processed in 52086us (52617us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788840002.175552:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788840002.177997:0:23422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cad500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23422:1875734060854016:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788840002.178017:0:23422:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:3.0:1788840002.178066:0:23422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23422:1875734060854144:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788840002.178136:0:23422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840002.178172:0:23422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647af23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788840002.178262:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060854144 00000100:00100000:2.0:1788840002.178269:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060854144 00000100:00100000:2.0:1788840002.178310:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788840002.178318:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23422:x1875734060854144:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788840002.178398:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23422:x1875734060854144:12345-0@lo:900:osp-pre-1-1.0 Request processed in 80us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840002.178406:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788840002.183188:0:23422:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766ec000 x1875734060854144/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788840018 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788840002.183207:0:23422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23422:1875734060854144:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1788840002.829615:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788840002.947078:0:23431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788840003.851317:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788840004.862912:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788840005.388520:0:25358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788840005.503286:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060854272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788840005.503357:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840005.503500:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060854272 00000100:00100000:2.0:1788840005.503509:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060854272 00000100:00100000:2.0:1788840005.503573:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788840005.503583:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060854272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788840005.503632:0:24188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788840005.503676:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060854272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840005.503694:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788840005.503884:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788840005.504123:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060854272:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788840005.886886:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788840006.019495:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060854528:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788840006.019567:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840006.019638:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788840006.019645:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060854400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788840006.019667:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840006.019703:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060854528 00000100:00100000:2.0:1788840006.019710:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060854528 00000100:00100000:2.0:1788840006.019747:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060854400 00000100:00100000:2.0:1788840006.019750:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060854400 00000100:00100000:2.0:1788840006.019765:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788840006.019817:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060854528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788840006.019849:0:22681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788840006.019890:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060854528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840006.019897:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788840006.019913:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788840006.019919:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060854400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788840006.019933:0:22681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788840006.019956:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060854400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 38us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840006.019962:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788840006.020002:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060854400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788840006.020014:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060854528:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788840006.336808:0:25410:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788840006.337031:0:25410:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788840006.912202:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788840007.039117:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788840007.039176:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060854656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788840007.039291:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840007.039428:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788840007.039440:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060854784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788840007.039522:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060854912:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788840007.039545:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.039904:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060855040:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.039938:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.039960:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060855552:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.039982:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.040070:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060856064:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040093:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.040110:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788840007.040115:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060855424:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040130:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.040143:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060855936:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040159:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.040171:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060856448:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040189:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.040215:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060855040 00000100:00100000:2.0:1788840007.040221:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060855040 00000100:00100000:2.0:1788840007.040264:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788840007.040271:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3617:x1875734060855040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040316:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3617:x1875734060855040:12345-0@lo:400:kworker.0 Request processed in 45us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.040323:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788840007.040353:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060855552 00000100:00100000:2.0:1788840007.040356:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060855552 00000100:00100000:2.0:1788840007.040393:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788840007.040399:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060855552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040433:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060855552:12345-0@lo:400:kworker.0 Request processed in 34us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.040438:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788840007.040456:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060856064 00000100:00100000:2.0:1788840007.040460:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060856064 00000100:00100000:2.0:1788840007.040487:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060855424 00000100:00100000:2.0:1788840007.040490:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060855424 00000100:00100000:2.0:1788840007.040500:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060855936 00000100:00100000:2.0:1788840007.040502:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060855936 00000100:00100000:2.0:1788840007.040511:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060856448 00000100:00100000:2.0:1788840007.040513:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060856448 00000100:00100000:2.0:1788840007.040525:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788840007.040529:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060856064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040559:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060856064:12345-0@lo:400:kworker.0 Request processed in 29us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.040564:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788840007.040576:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788840007.040581:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060855424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040617:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060855424:12345-0@lo:400:kworker.0 Request processed in 24us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.040623:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788840007.040635:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788840007.040640:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060855936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040664:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060855936:12345-0@lo:400:kworker.0 Request processed in 24us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.040678:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788840007.040690:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788840007.040695:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060856448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040722:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060856448:12345-0@lo:400:kworker.0 Request processed in 27us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.040727:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788840007.040756:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788840007.040760:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788840007.040816:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c76300 x1875734060855424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788840007.040830:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060855424:0@lo:400:kworker.0 00010000:00080000:2.0:1788840007.040841:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aedc00 x1875734060855936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788840007.040849:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060855936:0@lo:400:kworker.0 00010000:00080000:2.0:1788840007.040858:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aec380 x1875734060856448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788840007.040865:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060856448:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040872:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060855040:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040880:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060855552:0@lo:400:kworker.0 00010000:00080000:2.0:1788840007.040889:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aed880 x1875734060856064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788840007.040897:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060856064:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040943:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060855296:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.040971:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.041460:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060855808:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.041493:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.041555:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060856320:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.041577:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.041601:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788840007.041617:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060855168:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.041639:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.041656:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060855680:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.041675:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840007.041871:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060856192:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.041898:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840007.041961:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060855296 00000100:00100000:1.0:1788840007.041969:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060855296 00000100:00100000:2.0:1788840007.042062:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060855808 00000100:00100000:2.0:1788840007.042066:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060855808 00000100:00100000:2.0:1788840007.042103:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060855680 00000100:00100000:2.0:1788840007.042106:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060855680 00000100:00100000:2.0:1788840007.042121:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788840007.042127:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875734060855808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.042169:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875734060855808:12345-0@lo:400:kworker.0 Request processed in 42us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.042175:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788840007.042188:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788840007.042194:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060855680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.042219:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060855680:12345-0@lo:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.042232:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788840007.042250:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060855168 00000100:00100000:2.0:1788840007.042253:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060855168 00000100:00100000:2.0:1788840007.042273:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788840007.042278:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060855168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.042308:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060855168:12345-0@lo:400:kworker.0 Request processed in 30us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.042314:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788840007.042334:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060856320 00000100:00100000:2.0:1788840007.042337:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060856320 00000100:00100000:2.0:1788840007.042359:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060856192 00000100:00100000:2.0:1788840007.042362:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060856192 00000100:00100000:2.0:1788840007.042377:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788840007.042383:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060856320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.042412:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060856320:12345-0@lo:400:kworker.0 Request processed in 29us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.042418:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788840007.042428:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788840007.042434:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060856192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.042460:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060856192:12345-0@lo:400:kworker.0 Request processed in 26us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.042466:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788840007.042483:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788840007.042487:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788840007.042490:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788840007.042491:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788840007.042522:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060855168:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.042543:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060855680:0@lo:400:kworker.0 00010000:00080000:2.0:1788840007.042553:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aef800 x1875734060856192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788840007.042563:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060856192:0@lo:400:kworker.0 00000100:00100000:2.0:1788840007.042573:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060855808:0@lo:400:kworker.0 00010000:00080000:2.0:1788840007.042581:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aefb80 x1875734060856320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788840007.042589:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060856320:0@lo:400:kworker.0 00000100:00100000:1.0:1788840007.042678:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788840007.042686:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060855296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840007.042825:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060855296:12345-0@lo:400:kworker.0 Request processed in 40us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840007.042832:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788840007.042951:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060855296:0@lo:400:kworker.0 00000100:00100000:3.0:1788840007.043737:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060854656 00000100:00100000:3.0:1788840007.043747:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060854656 00000100:00100000:2.0:1788840007.044017:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060854912 00000100:00100000:2.0:1788840007.044022:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060854912 00000100:00100000:2.0:1788840007.044044:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788840007.044052:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060854656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788840007.044089:0:24187:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788840007.044152:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840007.044267:0:24188:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788840007.044279:0:24188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788840007.044542:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060854784 00000100:00100000:1.0:1788840007.044546:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060854784 00000100:00100000:3.0:1788840007.044672:0:25441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788840007.044679:0:25441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060854912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788840007.044697:0:25441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788840007.044758:0:25441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060854912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (5211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840007.044765:0:25441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788840007.044811:0:25441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788840007.044817:0:25441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060854784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788840007.044826:0:25441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788840007.044858:0:25441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060854784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840007.044864:0:25441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788840007.045086:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060854784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788840007.045180:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060854656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1128us (5889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.045187:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788840007.045206:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788840007.045259:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060854656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788840007.045340:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060854912:0@lo:13:osp-pre-1-1.0 00000020:00000004:3.0:1788840007.248567:0:25461:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788840007.248867:0:25461:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788840007.518420:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840007.518640:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050261632 00000100:00100000:3.0:1788840007.518651:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050261632 00000100:00100000:3.0:1788840007.518699:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:3.0:1788840007.518708:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2388:x1875734050261632:12345-192.168.203.52@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788840007.518736:0:22672:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 176971ca-bf30-437e-868a-3adf0e6b2af5@192.168.203.52@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:3.0:1788840007.519007:0:22672:0:(genops.c:1385:class_connect()) connect: client 176971ca-bf30-437e-868a-3adf0e6b2af5, cookie 0xad5b343a26574a7f 00000100:00080000:3.0:1788840007.519177:0:22672:0:(import.c:65:import_set_state_nolock()) ffff8ab64744a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788840007.519299:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+5:2388:x1875734050261632:12345-192.168.203.52@tcp:250:mount.lustre.0 Request processed in 589us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840007.519309:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:0.0:1788840007.551018:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840007.551122:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050261760 00000100:00100000:2.0:1788840007.551132:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050261760 00000100:00100000:2.0:1788840007.551192:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:2.0:1788840007.551202:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+5:18131:x1875734050261760:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788840007.551219:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840007.551249:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647842600/0xad5b343a26574a86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74de2 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840007.551279:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842600/0xad5b343a26574a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74de2 expref: 6 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840007.551291:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647842600/0xad5b343a26574a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74de2 expref: 6 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840007.551300:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842600, rc 0) 00000100:00100000:2.0:1788840007.551358:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+6:18131:x1875734050261760:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 158us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.551365:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:0.0:1788840007.555942:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840007.556041:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050261888 00000100:00100000:2.0:1788840007.556050:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050261888 00000100:00100000:2.0:1788840007.556111:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:2.0:1788840007.556122:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+6:18131:x1875734050261888:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788840007.556240:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+6:18131:x1875734050261888:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 119us (309us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788840007.556248:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:1.0:1788840007.584868:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840007.585046:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050262016 00000100:00100000:3.0:1788840007.585056:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050262016 00000100:00100000:3.0:1788840007.585123:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:3.0:1788840007.585134:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f0e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+6:18131:x1875734050262016:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788840007.585151:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788840007.585171:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647958000/0xad5b343a26574a8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74de9 expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840007.585204:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647958000/0xad5b343a26574a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74de9 expref: 7 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840007.585217:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647958000/0xad5b343a26574a8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74de9 expref: 7 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840007.585227:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958000, rc 0) 00000100:00100000:3.0:1788840007.585279:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f0e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+7:18131:x1875734050262016:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 147us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840007.585286:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:0.0:1788840007.596700:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840007.604676:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050262144 00000100:00100000:3.0:1788840007.604691:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050262144 00000100:00100000:3.0:1788840007.604760:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:3.0:1788840007.604788:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f0e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+7:18131:x1875734050262144:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788840007.604976:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f0e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+8:18131:x1875734050262144:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 206us (8285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840007.604985:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:0.0:1788840007.612548:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840007.612913:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050262272 00000100:00100000:2.0:1788840007.612925:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050262272 00000100:00100000:2.0:1788840007.612989:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1788840007.613000:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+8:18131:x1875734050262272:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788840007.613164:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+8:18131:x1875734050262272:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 166us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.613172:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1788840007.616827:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840007.617009:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050262400 00000100:00100000:1.0:1788840007.617021:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050262400 00000100:00100000:1.0:1788840007.617082:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:1.0:1788840007.617093:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+8:18151:x1875734050262400:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788840007.617421:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+8:18151:x1875734050262400:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 328us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840007.617429:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:0.0:1788840007.669146:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840007.669464:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050262528 00000100:00100000:3.0:1788840007.669475:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050262528 00000100:00100000:2.0:1788840007.669713:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:2.0:1788840007.669725:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+8:18151:x1875734050262528:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788840007.669893:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+8:18151:x1875734050262528:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 170us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.669901:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:0.0:1788840007.688718:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840007.688850:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050262656 00000100:00100000:2.0:1788840007.688861:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050262656 00000100:00100000:2.0:1788840007.688921:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:2.0:1788840007.688931:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+8:18151:x1875734050262656:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788840007.689081:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64832f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+8:18151:x1875734050262656:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 150us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.689089:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:1.0:1788840007.708236:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840007.708318:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050262784 00000100:00100000:3.0:1788840007.708328:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050262784 00000100:00100000:3.0:1788840007.708384:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:3.0:1788840007.708394:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+8:18131:x1875734050262784:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788840007.708411:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788840007.708428:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647958800/0xad5b343a26574a94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74e1a expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840007.708514:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647958800/0xad5b343a26574a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e1a expref: 9 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840007.708612:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647958800/0xad5b343a26574a94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e1a expref: 9 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840007.708623:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958800, rc 0) 00000100:00100000:3.0:1788840007.709581:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64832c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+9:18131:x1875734050262784:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 1181us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840007.709599:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:1.0:1788840007.726355:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840007.726611:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050262912 00000100:00100000:0.0:1788840007.726621:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050262912 00000100:00100000:0.0:1788840007.726684:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:0.0:1788840007.726694:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+9:18131:x1875734050262912:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788840007.726720:0:22669:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788840007.726744:0:22669:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788840007.726749:0:22669:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788840007.726752:0:22669:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788840007.726912:0:22669:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788840007.726914:0:22669:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788840007.743153:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64832d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+9:18131:x1875734050262912:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 16449us (16796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.743168:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:1.0:1788840007.753970:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840007.754054:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050263040 00000100:00100000:3.0:1788840007.754063:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050263040 00000100:00100000:3.0:1788840007.754120:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:3.0:1788840007.754130:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+9:18131:x1875734050263040:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788840007.754149:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788840007.754168:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647959000/0xad5b343a26574a9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74e21 expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840007.754196:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647959000/0xad5b343a26574a9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e21 expref: 10 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840007.754225:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647959000/0xad5b343a26574a9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e21 expref: 10 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840007.754235:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959000, rc 0) 00000100:00100000:3.0:1788840007.754297:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64832d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+10:18131:x1875734050263040:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 167us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840007.754304:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:1.0:1788840007.757630:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840007.757789:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050263168 00000100:00100000:2.0:1788840007.757799:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050263168 00000100:00100000:2.0:1788840007.757856:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:2.0:1788840007.757867:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+10:18131:x1875734050263168:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788840007.758033:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+10:18131:x1875734050263168:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 168us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.758041:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:0.0:1788840007.760016:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840007.760295:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050263296 00000100:00100000:2.0:1788840007.760305:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050263296 00000100:00100000:2.0:1788840007.760373:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:2.0:1788840007.760383:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+10:18131:x1875734050263296:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788840007.760541:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+10:18131:x1875734050263296:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 159us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.760551:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:1.0:1788840007.772473:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840007.772568:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050263424 00000100:00100000:3.0:1788840007.772578:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050263424 00000100:00100000:3.0:1788840007.772692:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:3.0:1788840007.772702:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+10:18156:x1875734050263424:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788840007.772911:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+10:18156:x1875734050263424:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 209us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840007.772919:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:1.0:1788840007.777220:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840007.777312:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050263552 00000100:00100000:0.0:1788840007.777323:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050263552 00000100:00100000:0.0:1788840007.777378:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:0.0:1788840007.777388:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+10:18156:x1875734050263552:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788840007.777837:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+10:18156:x1875734050263552:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 449us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840007.777847:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:0.0:1788840007.797260:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840007.797555:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050263680 00000100:00100000:2.0:1788840007.797567:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050263680 00000100:00100000:2.0:1788840007.797638:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788840007.797647:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1875734050263680:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788840007.797679:0:22678:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 41172893-7edf-4e98-bf08-ce61943bc35d@192.168.203.52@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:2.0:1788840007.797744:0:22678:0:(genops.c:1385:class_connect()) connect: client 41172893-7edf-4e98-bf08-ce61943bc35d, cookie 0xad5b343a26574aa2 00000004:00100000:2.0:1788840007.798005:0:22678:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788840007.798216:0:22678:0:(import.c:65:import_set_state_nolock()) ffff8ab647bf7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788840007.798281:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+6:2388:x1875734050263680:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 634us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.798289:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788840007.805461:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840007.805765:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050263936 00000100:00100000:2.0:1788840007.805818:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050263936 00000100:00100000:2.0:1788840007.805860:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788840007.805868:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1875734050263936:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788840007.805901:0:22677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 41172893-7edf-4e98-bf08-ce61943bc35d@192.168.203.52@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:2.0:1788840007.805952:0:22677:0:(genops.c:1385:class_connect()) connect: client 41172893-7edf-4e98-bf08-ce61943bc35d, cookie 0xad5b343a26574aa9 00000004:00100000:2.0:1788840007.805974:0:22677:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788840007.806171:0:22677:0:(import.c:65:import_set_state_nolock()) ffff8ab74434b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788840007.806247:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+6:2388:x1875734050263936:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 378us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.806277:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1788840007.836095:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840007.836141:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840007.836226:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050263808 00000100:00100000:0.0:1788840007.836236:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050263808 00000100:00100000:0.0:1788840007.836316:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050264064 00000100:00100000:0.0:1788840007.836320:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050264064 00000100:00100000:0.0:1788840007.836347:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788840007.836357:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+6:0:x1875734050263808:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788840007.836395:0:23418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788840007.836485:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+6:0:x1875734050263808:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 130us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840007.836493:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788840007.836513:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788840007.836520:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+6:0:x1875734050264064:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788840007.836537:0:23418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788840007.836571:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+6:0:x1875734050264064:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840007.836577:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00080000:3.0:1788840007.837037:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788840007.837043:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788840007.846351:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840007.846449:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050264192 00000100:00100000:0.0:1788840007.846462:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050264192 00000100:00100000:0.0:1788840007.846532:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1788840007.846543:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+6:18131:x1875734050264192:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788840007.846578:0:23418:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788840007.846970:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+6:18131:x1875734050264192:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 428us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840007.846980:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1788840007.855408:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840007.855507:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050264320 00000100:00100000:1.0:1788840007.855517:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050264320 00000100:00100000:1.0:1788840007.855580:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788840007.855709:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+6:18131:x1875734050264320:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788840007.856024:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+6:18131:x1875734050264320:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 434us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840007.856033:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788840007.863644:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840007.863691:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840007.863723:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840007.863808:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840007.863836:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840007.864122:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050264704 00000100:00100000:2.0:1788840007.864132:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050264704 00000100:00100000:2.0:1788840007.864194:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788840007.864204:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:41172893-7edf-4e98-bf08-ce61943bc35d+6:18131:x1875734050264704:12345-192.168.203.52@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788840007.864294:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:41172893-7edf-4e98-bf08-ce61943bc35d+6:18131:x1875734050264704:12345-192.168.203.52@tcp:900:mount.lustre.0 Request processed in 92us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.864302:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788840007.864326:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050264960 00000100:00100000:2.0:1788840007.864330:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050264960 00000100:00100000:2.0:1788840007.864357:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:2.0:1788840007.864364:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+6:2391:x1875734050264960:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788840007.864394:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+6:2391:x1875734050264960:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.864401:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1788840007.865048:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050264448 00000100:00100000:0.0:1788840007.865056:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050264448 00000100:00100000:0.0:1788840007.865088:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050264576 00000100:00100000:0.0:1788840007.865091:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050264576 00000100:00100000:0.0:1788840007.865112:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788840007.865118:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1875734050264448:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788840007.865146:0:24185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 41172893-7edf-4e98-bf08-ce61943bc35d@192.168.203.52@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:0.0:1788840007.865178:0:24185:0:(genops.c:1385:class_connect()) connect: client 41172893-7edf-4e98-bf08-ce61943bc35d, cookie 0xad5b343a26574ab0 00002000:00100000:0.0:1788840007.865189:0:24185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 41172893-7edf-4e98-bf08-ce61943bc35d/ffff8ab646427000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788840007.865206:0:24185:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788840007.865372:0:24185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788840007.865401:0:24185:0:(import.c:65:import_set_state_nolock()) ffff8ab646425800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788840007.865448:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41172893-7edf-4e98-bf08-ce61943bc35d+6:2388:x1875734050264448:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 328us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840007.865456:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788840007.865472:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788840007.865476:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1875734050264576:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788840007.865492:0:24185:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 41172893-7edf-4e98-bf08-ce61943bc35d@192.168.203.52@tcp t0 exp 0000000000000000 cur 662 last 0 00000020:00000080:0.0:1788840007.865507:0:24185:0:(genops.c:1385:class_connect()) connect: client 41172893-7edf-4e98-bf08-ce61943bc35d, cookie 0xad5b343a26574ab7 00002000:00100000:0.0:1788840007.865513:0:24185:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 41172893-7edf-4e98-bf08-ce61943bc35d/ffff8ab646422000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788840007.865518:0:24185:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788840007.865653:0:24185:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788840007.865668:0:24185:0:(import.c:65:import_set_state_nolock()) ffff8ab646421000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788840007.865690:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41172893-7edf-4e98-bf08-ce61943bc35d+6:2388:x1875734050264576:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 212us (1967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840007.865696:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788840007.866958:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840007.867531:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050265088 00000100:00100000:0.0:1788840007.867542:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050265088 00000100:00100000:1.0:1788840007.867924:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050264832 00000100:00100000:1.0:1788840007.867930:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050264832 00000100:00100000:1.0:1788840007.867970:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:1.0:1788840007.867979:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+10:2391:x1875734050264832:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788840007.868040:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+10:2391:x1875734050264832:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 63us (4270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840007.868048:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:1.0:1788840007.868105:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1788840007.868113:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+6:18131:x1875734050265088:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788840007.868683:0:22679:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 498us 00000001:00100000:0.0:1788840007.873226:0:24180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41172893-7edf-4e98-bf08-ce61943bc35d 00000001:00100000:3.0:1788840007.874242:0:24998:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41172893-7edf-4e98-bf08-ce61943bc35d 00000001:00080000:3.0:1788840007.874255:0:24998:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000004:00200000:2.0:1788840007.886735:0:22679:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788840007.886912:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+6:18131:x1875734050265088:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 18794us (19954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840007.886927:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00010000:00010000:1.0:1788840007.935116:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788840008.083345:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840008.083440:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050265216 00000100:00100000:2.0:1788840008.083457:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050265216 00000100:00100000:2.0:1788840008.083518:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1788840008.083529:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+6:18181:x1875734050265216:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:2.0:1788840008.083549:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840008.083576:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26574abe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74e52 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840008.083685:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ac5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840008.083700:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840008.083713:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788840008.084028:0:22678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788840008.084033:0:22678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788840008.084080:0:22678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840008.084106:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26574abe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e52 expref: 8 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840008.084122:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e52 expref: 7 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840008.084130:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800e00) 00010000:00010000:2.0:1788840008.084133:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788840008.084136:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843400, rc 0) 00000100:00100000:2.0:1788840008.084194:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+7:18181:x1875734050265216:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 667us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840008.084200:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00010000:00010000:3.0:1788840008.959003:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788840009.279512:0:22712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788840009.983033:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788840010.187185:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840010.187294:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050265344 00000100:00100000:0.0:1788840010.187302:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050265344 00000100:00100000:0.0:1788840010.187388:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1788840010.187400:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+7:18233:x1875734050265344:12345-192.168.203.52@tcp:41:lfs.0 00000004:00000024:0.0:1788840010.187439:0:22676:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788840010.187549:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+7:18233:x1875734050265344:12345-192.168.203.52@tcp:41:lfs.0 Request processed in 152us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840010.187557:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00080000:3.0:1788840010.187859:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788840010.189307:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840010.190933:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050265472 00000100:00100000:2.0:1788840010.190968:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050265472 00000100:00100000:2.0:1788840010.191142:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788840010.191155:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+6:18233:x1875734050265472:12345-192.168.203.52@tcp:41:lfs.0 00000004:00000024:2.0:1788840010.191196:0:22678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788840010.191315:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+6:18233:x1875734050265472:12345-192.168.203.52@tcp:41:lfs.0 Request processed in 163us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840010.191323:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00080000:3.0:1788840010.197041:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788840010.199333:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840010.199419:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050265600 00000100:00100000:3.0:1788840010.199428:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050265600 00000100:00100000:3.0:1788840010.199501:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1788840010.199512:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41172893-7edf-4e98-bf08-ce61943bc35d+5:18233:x1875734050265600:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:3.0:1788840010.199568:0:24188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788840010.199686:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41172893-7edf-4e98-bf08-ce61943bc35d+5:18233:x1875734050265600:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 175us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840010.199694:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:2.0:1788840010.200362:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788840010.204452:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840010.204618:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050265728 00000100:00100000:2.0:1788840010.204629:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050265728 00000100:00100000:2.0:1788840010.204702:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788840010.204714:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41172893-7edf-4e98-bf08-ce61943bc35d+5:18233:x1875734050265728:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:2.0:1788840010.204749:0:24187:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788840010.204859:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:41172893-7edf-4e98-bf08-ce61943bc35d+5:18233:x1875734050265728:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 147us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840010.204867:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00080000:3.0:1788840010.204927:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788840010.489070:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840010.489158:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050265856 00000100:00100000:2.0:1788840010.489169:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050265856 00000100:00100000:2.0:1788840010.489270:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:2.0:1788840010.489281:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+10:18268:x1875734050265856:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788840010.489301:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840010.489318:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647842000/0xad5b343a26574acc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74e59 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840010.489372:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842000/0xad5b343a26574acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e59 expref: 11 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840010.489409:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647842000/0xad5b343a26574acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e59 expref: 11 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840010.489420:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842000, rc 0) 00000100:00100000:2.0:1788840010.489667:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18268:x1875734050265856:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 387us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840010.489674:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:0.0:1788840010.491973:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840010.492280:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050265984 00000100:00100000:1.0:1788840010.492291:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050265984 00000100:00100000:1.0:1788840010.492342:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:1.0:1788840010.492352:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77684e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18268:x1875734050265984:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788840010.492549:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77684e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18268:x1875734050265984:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 198us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840010.492558:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:0.0:1788840010.496130:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840010.496238:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050266112 00000100:00100000:1.0:1788840010.496248:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050266112 00000100:00100000:1.0:1788840010.496342:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:1.0:1788840010.496353:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18268:x1875734050266112:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788840010.497228:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18268:x1875734050266112:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 872us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840010.497240:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:0.0:1788840010.503245:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840010.503669:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050266240 00000100:00100000:1.0:1788840010.503678:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050266240 00000100:00100000:1.0:1788840010.503740:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:1.0:1788840010.503976:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18272:x1875734050266240:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788840010.504116:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18272:x1875734050266240:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 145us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840010.504124:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:0.0:1788840010.523553:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840010.523764:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050266368 00000100:00100000:2.0:1788840010.523797:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050266368 00000100:00100000:2.0:1788840010.523857:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:2.0:1788840010.523867:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18272:x1875734050266368:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788840010.524017:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18272:x1875734050266368:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 152us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840010.524025:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:0.0:1788840010.545930:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840010.546214:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050266496 00000100:00100000:3.0:1788840010.546223:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050266496 00000100:00100000:3.0:1788840010.546276:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:3.0:1788840010.546286:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18272:x1875734050266496:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788840010.546447:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18272:x1875734050266496:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 162us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840010.546457:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:0.0:1788840010.549380:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840010.550512:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050266624 00000100:00100000:1.0:1788840010.550526:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050266624 00000100:00100000:1.0:1788840010.550605:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:1.0:1788840010.550617:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18268:x1875734050266624:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788840010.550634:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788840010.550653:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab746e4fe00/0xad5b343a26574ad3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74e8a expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840010.550709:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab746e4fe00/0xad5b343a26574ad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e8a expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840010.550723:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab746e4fe00/0xad5b343a26574ad3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e8a expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840010.550732:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4fe00, rc 0) 00000100:00100000:1.0:1788840010.550824:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+12:18268:x1875734050266624:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 210us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840010.550831:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:0.0:1788840010.554907:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840010.555063:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050266752 00000100:00100000:2.0:1788840010.555074:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050266752 00000100:00100000:2.0:1788840010.555133:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:2.0:1788840010.555143:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+12:18268:x1875734050266752:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788840010.555168:0:22669:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788840010.555191:0:22669:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788840010.555207:0:22669:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788840010.555210:0:22669:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788840010.555213:0:22669:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788840010.555215:0:22669:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788840010.558262:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+12:18268:x1875734050266752:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 3111us (3355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840010.558288:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:0.0:1788840010.565691:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840010.565823:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050266880 00000100:00100000:3.0:1788840010.565833:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050266880 00000100:00100000:3.0:1788840010.565937:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:3.0:1788840010.565947:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+12:18268:x1875734050266880:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788840010.565963:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788840010.565980:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647959c00/0xad5b343a26574ada lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74e91 expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840010.566008:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647959c00/0xad5b343a26574ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e91 expref: 13 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840010.566017:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647959c00/0xad5b343a26574ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e91 expref: 13 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840010.566025:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959c00, rc 0) 00000100:00100000:3.0:1788840010.566094:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18268:x1875734050266880:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 149us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840010.566101:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:0.0:1788840010.569917:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840010.570034:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050267008 00000100:00100000:2.0:1788840010.570043:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050267008 00000100:00100000:2.0:1788840010.570114:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:2.0:1788840010.570122:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18268:x1875734050267008:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788840010.570248:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18268:x1875734050267008:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 127us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840010.570253:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:0.0:1788840010.572741:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840010.573002:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050267136 00000100:00100000:3.0:1788840010.573013:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050267136 00000100:00100000:3.0:1788840010.573070:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:3.0:1788840010.573080:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18268:x1875734050267136:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788840010.573224:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18268:x1875734050267136:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 146us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840010.573232:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:0.0:1788840010.577101:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840010.577194:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050267264 00000100:00100000:2.0:1788840010.577215:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050267264 00000100:00100000:2.0:1788840010.577280:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:2.0:1788840010.577292:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18277:x1875734050267264:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788840010.577492:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18277:x1875734050267264:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 202us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840010.577501:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:0.0:1788840010.590415:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840010.590626:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050267392 00000100:00100000:1.0:1788840010.590636:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050267392 00000100:00100000:1.0:1788840010.590690:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:1.0:1788840010.590708:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18277:x1875734050267392:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788840010.590892:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18277:x1875734050267392:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 193us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840010.590900:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:0.0:1788840010.604060:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840010.604096:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840010.604196:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050267520 00000100:00100000:2.0:1788840010.604207:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050267520 00000100:00100000:2.0:1788840010.604250:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050267776 00000100:00100000:2.0:1788840010.604254:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050267776 00000100:00100000:2.0:1788840010.604280:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788840010.604288:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1875734050267520:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788840010.604317:0:23418:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1e7eeb6f-a098-4dd3-ab34-56852e5130f9@192.168.203.52@tcp t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:2.0:1788840010.604355:0:23418:0:(genops.c:1385:class_connect()) connect: client 1e7eeb6f-a098-4dd3-ab34-56852e5130f9, cookie 0xad5b343a26574ae1 00000004:00100000:2.0:1788840010.604380:0:23418:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788840010.604465:0:23418:0:(import.c:65:import_set_state_nolock()) ffff8ab7770c7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788840010.604555:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2388:x1875734050267520:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 266us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840010.604563:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788840010.604591:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1788840010.604597:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1875734050267776:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788840010.604612:0:23418:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1e7eeb6f-a098-4dd3-ab34-56852e5130f9@192.168.203.52@tcp t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:2.0:1788840010.604644:0:23418:0:(genops.c:1385:class_connect()) connect: client 1e7eeb6f-a098-4dd3-ab34-56852e5130f9, cookie 0xad5b343a26574ae8 00000004:00100000:2.0:1788840010.604656:0:23418:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788840010.604693:0:23418:0:(import.c:65:import_set_state_nolock()) ffff8ab7770c2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788840010.604727:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2388:x1875734050267776:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 129us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840010.604733:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788840010.615137:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840010.615174:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840010.615204:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840010.615280:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050267648 00000100:00100000:3.0:1788840010.615289:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050267648 00000100:00100000:3.0:1788840010.615353:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050267904 00000100:00100000:3.0:1788840010.615357:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050267904 00000100:00100000:3.0:1788840010.615371:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050268032 00000100:00100000:3.0:1788840010.615374:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050268032 00000100:00100000:3.0:1788840010.615387:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788840010.615395:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+7:0:x1875734050267648:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788840010.615431:0:22678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788840010.615497:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+7:0:x1875734050267648:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 102us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840010.615504:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788840010.615522:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788840010.615528:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:0:x1875734050267904:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788840010.615539:0:22678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788840010.615565:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:0:x1875734050267904:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 38us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840010.615601:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788840010.615614:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788840010.615633:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:18268:x1875734050268032:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788840010.615645:0:22678:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788840010.615667:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:18268:x1875734050268032:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 35us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840010.615673:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00080000:0.0:1788840010.615889:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788840010.615893:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788840010.621331:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840010.621409:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050268160 00000100:00100000:3.0:1788840010.621419:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050268160 00000100:00100000:3.0:1788840010.621485:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788840010.621494:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:18268:x1875734050268160:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788840010.622625:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:18268:x1875734050268160:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 1117us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840010.622637:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788840010.623480:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788840010.623499:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060856576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788840010.623564:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840010.623804:0:25441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060856576 00000100:00100000:2.0:1788840010.623811:0:25441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060856576 00000100:00100000:2.0:1788840010.623873:0:25441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788840010.623883:0:25441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060856576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788840010.623903:0:25441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788840010.623961:0:25441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060856576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840010.623968:0:25441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788840010.624177:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788840010.624212:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060856576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788840010.629336:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840010.629382:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840010.631553:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050268288 00000100:00100000:3.0:1788840010.631578:0:24186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050268288 00000100:00100000:3.0:1788840010.632114:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050268416 00000100:00100000:3.0:1788840010.632119:0:24186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050268416 00000100:00100000:3.0:1788840010.632154:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788840010.632162:0:24186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2388:x1875734050268288:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788840010.632194:0:24186:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1e7eeb6f-a098-4dd3-ab34-56852e5130f9@192.168.203.52@tcp t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:3.0:1788840010.632226:0:24186:0:(genops.c:1385:class_connect()) connect: client 1e7eeb6f-a098-4dd3-ab34-56852e5130f9, cookie 0xad5b343a26574aef 00002000:00100000:3.0:1788840010.632238:0:24186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1e7eeb6f-a098-4dd3-ab34-56852e5130f9/ffff8ab64744f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788840010.632249:0:24186:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788840010.632337:0:24186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788840010.632369:0:24186:0:(import.c:65:import_set_state_nolock()) ffff8ab64744d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788840010.632433:0:24186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2388:x1875734050268288:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 270us (3106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840010.632440:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788840010.632457:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788840010.632462:0:24186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2388:x1875734050268416:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788840010.632488:0:24186:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1e7eeb6f-a098-4dd3-ab34-56852e5130f9@192.168.203.52@tcp t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:3.0:1788840010.632505:0:24186:0:(genops.c:1385:class_connect()) connect: client 1e7eeb6f-a098-4dd3-ab34-56852e5130f9, cookie 0xad5b343a26574af6 00002000:00100000:3.0:1788840010.632510:0:24186:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1e7eeb6f-a098-4dd3-ab34-56852e5130f9/ffff8ab64744b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788840010.632516:0:24186:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788840010.632548:0:24186:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788840010.632562:0:24186:0:(import.c:65:import_set_state_nolock()) ffff8ab64744e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788840010.633093:0:24186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2388:x1875734050268416:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 627us (3708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840010.633101:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1788840010.633267:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840010.634065:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050268544 00000100:00100000:3.0:1788840010.634075:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050268544 00000100:00100000:3.0:1788840010.634171:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1788840010.634180:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:18268:x1875734050268544:12345-192.168.203.52@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788840010.634243:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:18268:x1875734050268544:12345-192.168.203.52@tcp:900:mount.lustre.0 Request processed in 64us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840010.634251:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788840010.640114:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840010.645138:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050268672 00000100:00100000:0.0:1788840010.645152:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050268672 00000100:00100000:0.0:1788840010.645282:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1788840010.645293:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:18268:x1875734050268672:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788840010.645381:0:22680:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788840010.645459:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:18268:x1875734050268672:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 169us (5356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840010.645467:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1788840010.801107:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840010.801207:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050268800 00000100:00100000:1.0:1788840010.801217:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050268800 00000100:00100000:1.0:1788840010.801280:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1788840010.801306:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:18300:x1875734050268800:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:1.0:1788840010.801329:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788840010.801351:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574afd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ec2 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840010.801416:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840010.801431:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840010.801446:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788840010.801490:0:22677:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788840010.801494:0:22677:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788840010.801515:0:22677:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840010.801542:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574afd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ec2 expref: 8 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840010.801560:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ec2 expref: 7 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840010.801599:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800e00) 00010000:00010000:1.0:1788840010.801602:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788840010.801606:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4fc00, rc 0) 00000100:00100000:1.0:1788840010.801670:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+7:18300:x1875734050268800:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 367us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840010.801688:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00010000:00010000:1.0:1788840011.007328:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788840011.135982:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788840011.136007:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060856704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788840011.136102:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840011.136686:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060856704 00000100:00100000:2.0:1788840011.136706:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060856704 00000100:00100000:2.0:1788840011.136763:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788840011.136789:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060856704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788840011.136843:0:22682:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788840011.136906:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060856704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840011.136913:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788840011.137173:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060856704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788840011.138151:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060856832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788840011.138208:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840011.138503:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060856832 00000100:00100000:2.0:1788840011.138510:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060856832 00000100:00100000:2.0:1788840011.138573:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788840011.138590:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060856832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788840011.138617:0:22681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788840011.146273:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060856832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7681us (8053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840011.146288:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788840011.159413:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060856832:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788840012.034547:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788840012.163934:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060856960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788840012.164000:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840012.164074:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060856960 00000100:00100000:1.0:1788840012.164080:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060856960 00000100:00100000:1.0:1788840012.164138:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788840012.164148:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060856960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788840012.164177:0:24188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788840012.164224:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060856960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840012.164231:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788840012.164255:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788840012.164290:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060857088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788840012.164318:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840012.164368:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060856960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788840012.164883:0:25441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060857088 00000100:00100000:2.0:1788840012.164888:0:25441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060857088 00000100:00100000:2.0:1788840012.164920:0:25441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788840012.164927:0:25441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060857088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788840012.164949:0:25441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788840012.164978:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060857216:0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.164993:0:25441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060857088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840012.165001:0:25441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788840012.165017:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840012.165029:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060857344:0@lo:400:kworker.0 00000100:00100000:1.0:1788840012.165048:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060857728:0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.165077:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840012.165093:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840012.165102:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060857856:0@lo:400:kworker.0 00000100:00100000:1.0:1788840012.165118:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060858240:0@lo:400:kworker.0 00000040:00080000:3.0:1788840012.165462:0:23431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788840012.166567:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840012.166636:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060857216 00000100:00100000:1.0:1788840012.166644:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060857216 00000100:00100000:1.0:1788840012.166684:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788840012.166692:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3614:x1875734060857216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840012.167004:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3614:x1875734060857216:12345-0@lo:400:kworker.0 Request processed in 312us (1987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840012.167011:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788840012.167044:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060857728 00000100:00100000:1.0:1788840012.167048:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060857728 00000100:00100000:1.0:1788840012.167078:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788840012.167085:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060857728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840012.167117:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060857728:12345-0@lo:400:kworker.0 Request processed in 33us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840012.167123:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788840012.167212:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060858240 00000100:00100000:1.0:1788840012.167216:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060858240 00000100:00100000:1.0:1788840012.167245:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788840012.167252:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060858240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840012.167282:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060858240:12345-0@lo:400:kworker.0 Request processed in 32us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840012.167288:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788840012.167330:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3614:1875734060857216:0@lo:400:kworker.0 00000100:00100000:1.0:1788840012.167344:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060857728:0@lo:400:kworker.0 00010000:00080000:1.0:1788840012.167371:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f8380 x1875734060858240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788840012.167382:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060858240:0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.174794:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840012.174857:0:24186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060857856 00000100:00100000:2.0:1788840012.174858:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060858368:0@lo:400:kworker.0 00000100:00100000:1.0:1788840012.174867:0:24186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060857856 00000100:00100000:2.0:1788840012.174927:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840012.174932:0:24186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788840012.174943:0:24186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060857856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.174977:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060857344 00000100:00100000:2.0:1788840012.174984:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060857344 00000100:00100000:1.0:1788840012.175011:0:24186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060857856:12345-0@lo:400:kworker.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840012.175018:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788840012.175022:0:24186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788840012.175031:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060857344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.175752:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060857344:12345-0@lo:400:kworker.0 Request processed in 723us (10673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840012.175760:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788840012.175822:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060858368 00000100:00100000:2.0:1788840012.175827:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060858368 00000100:00100000:2.0:1788840012.175858:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788840012.175866:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060858368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.175904:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060858368:12345-0@lo:400:kworker.0 Request processed in 39us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840012.175912:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788840012.175928:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788840012.175933:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788840012.175935:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788840012.175938:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788840012.175967:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060857600:0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.175996:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840012.176027:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060858112:0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.176048:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840012.176218:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060857600 00000100:00100000:1.0:1788840012.176223:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060857600 00000100:00100000:1.0:1788840012.176250:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788840012.176256:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060857600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840012.176294:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060857600:12345-0@lo:400:kworker.0 Request processed in 38us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840012.176300:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788840012.178272:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060858624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788840012.178329:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840012.178379:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060857088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788840012.178422:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060857600:0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.178435:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788840012.178460:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060858112 00000100:00100000:1.0:1788840012.178468:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060858112 00000100:00100000:1.0:1788840012.178522:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788840012.178530:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060858112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840012.178590:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060858112:12345-0@lo:400:kworker.0 Request processed in 61us (2540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840012.178598:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788840012.179194:0:25441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060858624 00000100:00100000:0.0:1788840012.179201:0:25441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060858624 00000100:00100000:0.0:1788840012.179240:0:25441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788840012.179248:0:25441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060858624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788840012.179265:0:25441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788840012.179306:0:25441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060858624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840012.179319:0:25441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788840012.180206:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060857472:0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.180259:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840012.180300:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060857984:0@lo:400:kworker.0 00000100:00100000:1.0:1788840012.180316:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060857472 00000100:00100000:1.0:1788840012.180324:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060857472 00000100:00100000:2.0:1788840012.180325:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840012.180342:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060858496:0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.180365:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840012.180455:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060858112:0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.180466:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788840012.180486:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060858624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788840012.182962:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060857984 00000100:00100000:1.0:1788840012.182977:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060857984 00000100:00100000:1.0:1788840012.183027:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060858496 00000100:00100000:1.0:1788840012.183031:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060858496 00000100:00100000:1.0:1788840012.183058:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788840012.183068:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060857472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840012.184625:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788840012.184658:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060857984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840012.184755:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060857984:12345-0@lo:400:kworker.0 Request processed in 118us (4429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840012.184763:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788840012.184801:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788840012.184809:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060858496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840012.184840:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060858496:12345-0@lo:400:kworker.0 Request processed in 33us (4474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840012.184846:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788840012.185276:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060857472:12345-0@lo:400:kworker.0 Request processed in 2206us (5012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840012.185286:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788840012.186101:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060857472:0@lo:400:kworker.0 00000100:00100000:3.0:1788840012.186130:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060857984:0@lo:400:kworker.0 00010000:00080000:3.0:1788840012.186148:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7450d9c00 x1875734060858496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788840012.186158:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060858496:0@lo:400:kworker.0 00000100:00080000:2.0:1788840012.186505:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788840012.186511:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788840012.186537:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060857344:0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.186551:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060857856:0@lo:400:kworker.0 00000100:00100000:2.0:1788840012.186563:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060858368:0@lo:400:kworker.0 00010000:00010000:3.0:1788840013.054950:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788840014.080419:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788840014.226927:0:23409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1e7eeb6f-a098-4dd3-ab34-56852e5130f9 00000001:00100000:0.0:1788840014.226951:0:23409:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 41172893-7edf-4e98-bf08-ce61943bc35d 00000001:00100000:3.0:1788840014.241297:0:22657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1e7eeb6f-a098-4dd3-ab34-56852e5130f9 00000001:00100000:3.0:1788840014.241311:0:22657:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41172893-7edf-4e98-bf08-ce61943bc35d 00000001:02000400:0.0:1788840014.386623:0:25559:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788840015.102968:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788840015.748589:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788840015.748614:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060858752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788840015.748692:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840015.749834:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060858752 00000100:00100000:1.0:1788840015.749846:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060858752 00000100:00100000:1.0:1788840015.749909:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788840015.749921:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060858752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788840015.749949:0:24187:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788840015.750013:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060858752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840015.750021:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788840015.750074:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060858752:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788840015.750812:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788840016.043954:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840016.043998:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840016.044033:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840016.044057:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840016.044075:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840016.044093:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840016.044113:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840016.044130:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840016.044150:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840016.044174:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050269440 00000100:00100000:0.0:1788840016.044183:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050269440 00000100:00100000:0.0:1788840016.044238:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050269952 00000100:00100000:0.0:1788840016.044255:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050269952 00000100:00100000:0.0:1788840016.044275:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050269312 00000100:00100000:0.0:1788840016.044276:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050269312 00000100:00100000:0.0:1788840016.044287:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050269824 00000100:00100000:0.0:1788840016.044289:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050269824 00000100:00100000:0.0:1788840016.044303:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788840016.044311:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41172893-7edf-4e98-bf08-ce61943bc35d+5:2391:x1875734050269440:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788840016.044379:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41172893-7edf-4e98-bf08-ce61943bc35d+5:2391:x1875734050269440:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 68us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840016.044386:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788840016.044402:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788840016.044408:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2391:x1875734050269952:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788840016.044430:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2391:x1875734050269952:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840016.044436:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788840016.044445:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788840016.044450:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41172893-7edf-4e98-bf08-ce61943bc35d+5:2391:x1875734050269312:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788840016.044469:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41172893-7edf-4e98-bf08-ce61943bc35d+5:2391:x1875734050269312:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 19us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840016.044474:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788840016.044482:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788840016.044488:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2391:x1875734050269824:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788840016.044506:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2391:x1875734050269824:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 18us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840016.044511:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788840016.044536:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050269184 00000100:00100000:0.0:1788840016.044539:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050269184 00000100:00100000:0.0:1788840016.044570:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050269696 00000100:00100000:0.0:1788840016.044573:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050269696 00000100:00100000:0.0:1788840016.044583:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050269056 00000100:00100000:0.0:1788840016.044586:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050269056 00000100:00100000:0.0:1788840016.044606:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050269568 00000100:00100000:0.0:1788840016.044608:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050269568 00000100:00100000:0.0:1788840016.044620:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788840016.044626:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+5:2391:x1875734050269184:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788840016.044654:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+5:2391:x1875734050269184:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840016.044660:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788840016.044672:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:0.0:1788840016.044678:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+5:2391:x1875734050269696:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788840016.044702:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+5:2391:x1875734050269696:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840016.044708:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:0.0:1788840016.044719:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:0.0:1788840016.044725:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+6:2391:x1875734050269056:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788840016.044747:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+6:2391:x1875734050269056:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840016.044753:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:0.0:1788840016.044764:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1788840016.044802:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2391:x1875734050269568:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788840016.044825:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2391:x1875734050269568:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 55us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840016.044839:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00080000:0.0:1788840016.044866:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788840016.044870:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788840016.044872:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788840016.044874:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788840016.045161:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050268928 00000100:00100000:2.0:1788840016.045167:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050268928 00000100:00100000:2.0:1788840016.045207:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:2.0:1788840016.045223:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+13:2391:x1875734050268928:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788840016.045257:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+13:2391:x1875734050268928:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840016.045264:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 147 00010000:00010000:2.0:1788840016.127079:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788840016.254891:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060859008:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788840016.254978:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840016.255749:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060858880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788840016.255814:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1788840016.257672:0:24998:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1e7eeb6f-a098-4dd3-ab34-56852e5130f9 00000100:00100000:1.0:1788840016.257851:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060859008 00000100:00100000:1.0:1788840016.257862:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060859008 00000100:00100000:2.0:1788840016.260029:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060858880 00000100:00100000:2.0:1788840016.260042:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060858880 00000100:00100000:2.0:1788840016.260078:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788840016.260088:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060859008:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788840016.260285:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788840016.260295:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060858880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788840016.260327:0:23417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788840016.260407:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060858880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (4592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840016.260414:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788840016.260481:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060858880:0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788840016.260562:0:22681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788840016.263389:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060859008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3294us (8403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840016.263403:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788840016.263969:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060859008:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1788840016.265937:0:24180:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1e7eeb6f-a098-4dd3-ab34-56852e5130f9 00010000:00010000:0.0:1788840017.159170:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788840017.278968:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060859136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788840017.279038:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840017.279144:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060859136 00000100:00100000:1.0:1788840017.279152:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060859136 00000100:00100000:1.0:1788840017.279208:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788840017.279219:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060859136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788840017.279247:0:24188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788840017.279296:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060859136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840017.279303:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788840017.279349:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060859136:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788840017.279409:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788840017.282610:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060859264:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.282690:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840017.282735:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060859776:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.282765:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840017.282803:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060860288:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.282827:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840017.282854:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788840017.282862:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060859648:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.282884:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840017.282901:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060860160:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.282934:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840017.282953:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060860672:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.282972:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840017.283005:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060859264 00000100:00100000:2.0:1788840017.283011:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060859264 00000100:00100000:2.0:1788840017.283054:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788840017.283063:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3617:x1875734060859264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.283119:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3617:x1875734060859264:12345-0@lo:400:kworker.0 Request processed in 58us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840017.283127:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788840017.283156:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060859392:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.283163:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060860288 00000100:00100000:2.0:1788840017.283168:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060860288 00000100:00100000:0.0:1788840017.283191:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840017.283202:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060859648 00000100:00100000:2.0:1788840017.283206:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060859648 00000100:00100000:2.0:1788840017.283221:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060860160 00000100:00100000:0.0:1788840017.283221:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060859904:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.283226:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060860160 00000100:00100000:2.0:1788840017.283245:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060860672 00000100:00100000:2.0:1788840017.283249:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060860672 00000100:00100000:0.0:1788840017.283252:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840017.283269:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788840017.283276:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060860416:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.283278:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060860288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840017.283306:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840017.283326:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788840017.283333:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060860288:12345-0@lo:400:kworker.0 Request processed in 55us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840017.283334:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060859520:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.283346:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788840017.283359:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060860416 00000100:00100000:2.0:1788840017.283362:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060860416 00000100:00100000:2.0:1788840017.283381:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788840017.283386:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060859648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.283413:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060859648:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840017.283426:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788840017.283438:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788840017.283443:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060860160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.283471:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060860160:12345-0@lo:400:kworker.0 Request processed in 28us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840017.283475:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788840017.283484:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788840017.283489:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060860672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.283512:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060860672:12345-0@lo:400:kworker.0 Request processed in 23us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840017.283517:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788840017.283530:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788840017.283546:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060860416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840017.283553:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840017.283575:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060860032:0@lo:400:kworker.0 00000100:00100000:0.0:1788840017.283607:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840017.283624:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060860544:0@lo:400:kworker.0 00000100:00100000:0.0:1788840017.283648:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788840017.283678:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7443da680 x1875734060860416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788840017.283692:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060860416:0@lo:400:kworker.0 00000100:00100000:0.0:1788840017.283713:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060859904 00000100:00100000:0.0:1788840017.283717:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060859904 00000100:00100000:0.0:1788840017.283757:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060859520 00000100:00100000:0.0:1788840017.283760:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060859520 00000100:00100000:0.0:1788840017.283801:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060860032 00000100:00100000:0.0:1788840017.283804:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060860032 00000100:00100000:0.0:1788840017.283827:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788840017.283833:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060859904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840017.284198:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060859904:12345-0@lo:400:kworker.0 Request processed in 364us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840017.284205:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788840017.284217:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788840017.284223:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060859520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840017.284245:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060859520:12345-0@lo:400:kworker.0 Request processed in 23us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840017.284650:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788840017.284665:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788840017.284673:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060860032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840017.284702:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060860032:12345-0@lo:400:kworker.0 Request processed in 32us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840017.284707:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788840017.285053:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060859520:0@lo:400:kworker.0 00000100:00100000:0.0:1788840017.285063:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060860032:0@lo:400:kworker.0 00000100:00100000:0.0:1788840017.285083:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060859904:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.287696:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060860416:12345-0@lo:400:kworker.0 Request processed in 4148us (4377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840017.287712:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788840017.287748:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060860544 00000100:00100000:2.0:1788840017.287756:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060860544 00000100:00100000:2.0:1788840017.287812:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788840017.287822:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060860544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.287911:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060860544:12345-0@lo:400:kworker.0 Request processed in 91us (4263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840017.287917:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788840017.287995:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060860544:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.288038:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060860800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788840017.288087:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840017.288123:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060859648:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.288141:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060860160:0@lo:400:kworker.0 00010000:00080000:2.0:1788840017.288154:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7443db480 x1875734060860672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788840017.288164:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060860672:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.288175:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060859264:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.288186:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060860288:0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.288225:0:25441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060860800 00000100:00100000:2.0:1788840017.288229:0:25441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060860800 00000100:00100000:2.0:1788840017.288258:0:25441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788840017.288258:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060859776 00000100:00100000:1.0:1788840017.288263:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060859776 00000100:00100000:2.0:1788840017.288265:0:25441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060860800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788840017.288280:0:25441:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788840017.288313:0:25441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060860800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840017.288319:0:25441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788840017.288333:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788840017.288336:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788840017.288339:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788840017.288341:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788840017.288364:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060860800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788840017.288384:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060859392 00000100:00100000:1.0:1788840017.288389:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788840017.288392:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060859392 00000100:00100000:1.0:1788840017.288396:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060859776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.288408:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788840017.288413:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060859392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840017.288443:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060859392:12345-0@lo:400:kworker.0 Request processed in 29us (5252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840017.288448:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788840017.288473:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060859392:0@lo:400:kworker.0 00000100:00100000:1.0:1788840017.288594:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060859776:12345-0@lo:400:kworker.0 Request processed in 198us (5827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840017.288601:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788840017.288668:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788840017.288677:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060860928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788840017.288703:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840017.288729:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060860928 00000100:00100000:1.0:1788840017.288732:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060860928 00000100:00100000:1.0:1788840017.288754:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788840017.288760:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060860928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788840017.288792:0:24187:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788840017.288844:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060860928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840017.288851:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788840017.288959:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060860928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788840017.289048:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060859776:0@lo:400:kworker.0 00000020:00000080:2.0:1788840017.905179:0:25707:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe64b76140 20000000:00000080:2.0:1788840017.905195:0:25707:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab746e58000 uarg=0000000000000000 20000000:01000000:2.0:1788840017.905240:0:25707:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788840017.905246:0:25707:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788840017.905250:0:25707:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788840017.905985:0:25708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788840017.906482:0:25707:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788840017.914307:0:25707:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788840017.914419:0:25707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.914441:0:25707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab777de6a00/0xad5b343a26574768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574761 expref: 23 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.914449:0:25707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab777de7800/0xad5b343a26574776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657476f expref: 23 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.914456:0:25707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e552e00/0xad5b343a265747b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265747ae expref: 23 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.914462:0:25707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e552200/0xad5b343a2657484f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574848 expref: 23 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.914493:0:25707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647959000/0xad5b343a26574a9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e21 expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.914500:0:25707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647959c00/0xad5b343a26574ada lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e91 expref: 12 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.914507:0:25707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.914622:0:25707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647959c00/0xad5b343a26574ada lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e91 expref: 12 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.914638:0:25707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647959c00/0xad5b343a26574ada lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e91 expref: 12 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840017.914725:0:25707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861056:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788840017.917127:0:25707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647959000/0xad5b343a26574a9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e21 expref: 12 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.917147:0:25707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647959000/0xad5b343a26574a9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e21 expref: 12 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840017.917162:0:25707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861184:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788840017.917217:0:25707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e552200/0xad5b343a2657484f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26574848 expref: 23 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.917226:0:25707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab75e552200/0xad5b343a2657484f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26574848 expref: 23 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840017.917253:0:25707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861312:0@lo:104: 00000100:00100000:2.0:1788840017.917296:0:25707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788840017.917339:0:25707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e552e00/0xad5b343a265747b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265747ae expref: 23 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.917348:0:25707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab75e552e00/0xad5b343a265747b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265747ae expref: 23 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840017.917356:0:25707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861440:0@lo:104: 00000100:00100000:2.0:1788840017.917377:0:25707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788840017.917411:0:25707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab777de7800/0xad5b343a26574776 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a2657476f expref: 23 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.917418:0:25707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab777de7800/0xad5b343a26574776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a2657476f expref: 23 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840017.917426:0:25707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861568:0@lo:104: 00000100:00100000:2.0:1788840017.917446:0:25707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788840017.917463:0:25707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab777de6a00/0xad5b343a26574768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26574761 expref: 23 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840017.917471:0:25707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab777de6a00/0xad5b343a26574768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26574761 expref: 23 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840017.917479:0:25707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861696:0@lo:104: 00000100:00100000:2.0:1788840017.917499:0:25707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840017.917509:0:25707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746e52d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788840017.917576:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060861312 00000100:00100000:1.0:1788840017.917583:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060861312 00000100:00100000:1.0:1788840017.917625:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060861440 00000100:00100000:1.0:1788840017.917628:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060861440 00000100:00100000:1.0:1788840017.917637:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060861568 00000100:00100000:1.0:1788840017.917639:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060861568 00000100:00100000:1.0:1788840017.917646:0:22660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060861696 00000100:00100000:1.0:1788840017.917659:0:22660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060861696 00000100:00100000:1.0:1788840017.917674:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788840017.917683:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+6:25707:x1875734060861312:12345-0@lo:104: 00010000:00010000:1.0:1788840017.917696:0:22660:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.917760:0:22660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788840017.917766:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+6:25707:x1875734060861312:12345-0@lo:104: Request processed in 85us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840017.917794:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788840017.917811:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788840017.917817:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+5:25707:x1875734060861440:12345-0@lo:104: 00010000:00010000:1.0:1788840017.917824:0:22660:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.917855:0:22660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788840017.917860:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+5:25707:x1875734060861440:12345-0@lo:104: Request processed in 44us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840017.917872:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788840017.917885:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788840017.917890:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+4:25707:x1875734060861568:12345-0@lo:104: 00010000:00010000:1.0:1788840017.917896:0:22660:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.917930:0:22660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788840017.917935:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+4:25707:x1875734060861568:12345-0@lo:104: Request processed in 45us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840017.917940:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788840017.917951:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788840017.917956:0:22660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:25707:x1875734060861696:12345-0@lo:104: 00010000:00010000:1.0:1788840017.917964:0:22660:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.917997:0:22660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788840017.918002:0:22660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+3:25707:x1875734060861696:12345-0@lo:104: Request processed in 46us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840017.918007:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788840017.918023:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788840017.918030:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918036:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788840017.918040:0:22666:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918057:0:22666:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788840017.918063:0:22666:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788840017.918068:0:22666:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788840017.918094:0:22666:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918100:0:22666:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788840017.918116:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918122:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de6600/0xad5b343a26574848 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657484f expref: -99 pid: 24997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918133:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788840017.918136:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918141:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4ee00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788840017.918143:0:22666:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918148:0:22666:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788840017.918153:0:22666:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788840017.918163:0:22666:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788840017.918177:0:22666:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918182:0:22666:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788840017.918196:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918202:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab746e4ee00/0xad5b343a265747ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265747b5 expref: -99 pid: 24179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918210:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788840017.918212:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918216:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6200 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788840017.918219:0:22666:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918224:0:22666:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788840017.918229:0:22666:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788840017.918233:0:22666:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788840017.918245:0:22666:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918249:0:22666:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788840017.918261:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918267:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a2657476f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574776 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918275:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788840017.918278:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918284:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68e00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788840017.918287:0:22666:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918292:0:22666:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788840017.918297:0:22666:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788840017.918301:0:22666:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788840017.918313:0:22666:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918318:0:22666:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788840017.918322:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918328:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab781e68e00/0xad5b343a26574761 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26574768 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918350:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840017.918351:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840017.918352:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840017.918359:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840017.918364:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788840017.918375:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060861952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788840017.918404:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840017.918426:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788840017.918431:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060862080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788840017.918466:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840017.918494:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060861952 00000100:00100000:1.0:1788840017.918499:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060861952 00010000:00010000:1.0:1788840017.918526:0:23433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e552e00/0xad5b343a265747b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265747ae expref: 24 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840017.918567:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060862080 00000100:00100000:1.0:1788840017.918570:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060862080 00010000:00010000:1.0:1788840017.918580:0:23433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab777de7800/0xad5b343a26574776 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657476f expref: 25 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840017.918596:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788840017.918601:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+25:3616:x1875734060861952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788840017.918611:0:23433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788840017.918616:0:23433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e552e00/0xad5b343a265747b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265747ae expref: 25 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918625:0:23433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e552e00/0xad5b343a265747b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265747ae expref: 25 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918651:0:23433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788840017.918679:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+25:3616:x1875734060861952:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840017.918686:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788840017.918699:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788840017.918705:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3616:x1875734060862080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788840017.918724:0:23433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788840017.918729:0:23433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab777de7800/0xad5b343a26574776 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657476f expref: 24 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918737:0:23433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab777de7800/0xad5b343a26574776 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a2657476f expref: 24 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840017.918746:0:23433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788840017.918767:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3616:x1875734060862080:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840017.918794:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788840017.918834:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060862080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788840017.918842:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3616:1875734060861952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788840017.918879:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788840017.919867:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3615:1875734060861824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788840017.919915:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840017.919958:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788840017.919964:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3615:1875734060862208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788840017.919984:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840017.920019:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060861824 00000100:00100000:3.0:1788840017.920025:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060861824 00010000:00010000:3.0:1788840017.920048:0:22664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e552200/0xad5b343a2657484f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26574848 expref: 24 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840017.920070:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060862208 00000100:00100000:3.0:1788840017.920073:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060862208 00010000:00010000:3.0:1788840017.920084:0:22664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab777de6a00/0xad5b343a26574768 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26574761 expref: 25 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840017.920113:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788840017.920120:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+25:3615:x1875734060861824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788840017.920131:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788840017.920136:0:22664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e552200/0xad5b343a2657484f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26574848 expref: 25 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.920144:0:22664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e552200/0xad5b343a2657484f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26574848 expref: 25 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.920159:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788840017.920188:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+25:3615:x1875734060861824:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840017.920194:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788840017.920211:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788840017.920216:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3615:x1875734060862208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788840017.920223:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788840017.920227:0:22664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab777de6a00/0xad5b343a26574768 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26574761 expref: 24 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.920234:0:22664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab777de6a00/0xad5b343a26574768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26574761 expref: 24 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.920242:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788840017.920262:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3615:x1875734060862208:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840017.920268:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788840017.920301:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3615:1875734060862208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788840017.920319:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3615:1875734060861824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788840017.920580:0:25707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552200/0xad5b343a2657484f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26574848 expref: 23 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840017.920601:0:25707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861312:0@lo:104: 00010000:00010000:2.0:1788840017.920615:0:25707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552e00/0xad5b343a265747b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265747ae expref: 22 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840017.920622:0:25707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cad500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861440:0@lo:104: 00010000:00010000:2.0:1788840017.920631:0:25707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de7800/0xad5b343a26574776 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a2657476f expref: 21 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840017.920642:0:25707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861568:0@lo:104: 00010000:00010000:2.0:1788840017.920659:0:25707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de6a00/0xad5b343a26574768 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26574761 expref: 20 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840017.920667:0:25707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861696:0@lo:104: 00000100:00100000:0.0:1788840017.925422:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840017.925457:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840017.925548:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050270208 00000100:00100000:3.0:1788840017.925559:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050270208 00010000:00010000:3.0:1788840017.925615:0:22664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647959000/0xad5b343a26574a9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e21 expref: 13 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840017.925659:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050270080 00000100:00100000:3.0:1788840017.925663:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050270080 00010000:00010000:3.0:1788840017.925675:0:22664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647959c00/0xad5b343a26574ada lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e91 expref: 14 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840017.925698:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788840017.925707:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:176971ca-bf30-437e-868a-3adf0e6b2af5+14:2389:x1875734050270208:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788840017.925722:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788840017.925728:0:22664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647959000/0xad5b343a26574a9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e21 expref: 14 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.925740:0:22664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647959000/0xad5b343a26574a9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e21 expref: 14 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.925760:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788840017.925835:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:176971ca-bf30-437e-868a-3adf0e6b2af5+14:2389:x1875734050270208:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 129us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840017.925843:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788840017.925893:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1788840017.925900:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:176971ca-bf30-437e-868a-3adf0e6b2af5+13:2389:x1875734050270080:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788840017.925907:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788840017.925927:0:22664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647959c00/0xad5b343a26574ada lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e91 expref: 13 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.925936:0:22664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647959c00/0xad5b343a26574ada lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e91 expref: 13 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.925948:0:22664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.925956:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.925974:0:22664:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.925982:0:22664:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.925990:0:22664:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.925997:0:22664:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.926002:0:22664:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788840017.926006:0:22664:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.926013:0:22664:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.926021:0:22664:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.926037:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788840017.926056:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:176971ca-bf30-437e-868a-3adf0e6b2af5+13:2389:x1875734050270080:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 157us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840017.926063:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00010000:00010000:2.0:1788840017.928377:0:25707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647959c00/0xad5b343a26574ada lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e91 expref: 12 pid: 22672 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840017.928401:0:25707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861056:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788840017.928484:0:25707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647959000/0xad5b343a26574a9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e21 expref: 11 pid: 22670 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840017.928495:0:25707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25707:1875734060861184:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788840017.928950:0:25707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.928964:0:25707:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.928968:0:25707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840017.928974:0:25707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647843e00/0xad5b343a26574b0b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840018.180097:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840019.199216:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788840019.433831:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840019.434967:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050270336 00000100:00100000:1.0:1788840019.434982:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050270336 00000100:00100000:1.0:1788840019.435054:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:1.0:1788840019.435065:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+11:18145:x1875734050270336:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788840019.435099:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788840019.435119:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab746e4ee00/0xad5b343a26574b12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ec9 expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.435148:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab746e4ee00/0xad5b343a26574b12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ec9 expref: 12 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.435161:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab746e4ee00/0xad5b343a26574b12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ec9 expref: 12 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.435170:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4ee00, rc 0) 00000100:00100000:1.0:1788840019.435234:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+12:18145:x1875734050270336:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 172us (1413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.435241:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:3.0:1788840019.438547:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840019.438805:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050270464 00000100:00100000:2.0:1788840019.438815:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050270464 00000100:00100000:2.0:1788840019.438879:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:2.0:1788840019.438889:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6419c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+12:18145:x1875734050270464:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788840019.440601:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6419c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+12:18145:x1875734050270464:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 1705us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840019.440613:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:0.0:1788840019.454171:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840019.454306:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050270592 00000100:00100000:1.0:1788840019.454317:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050270592 00000100:00100000:1.0:1788840019.454379:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:1.0:1788840019.454390:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+12:18145:x1875734050270592:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.454536:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+12:18145:x1875734050270592:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 148us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.454544:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:3.0:1788840019.472497:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840019.472662:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050270720 00000100:00100000:2.0:1788840019.472682:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050270720 00000100:00100000:2.0:1788840019.472735:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:2.0:1788840019.472744:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+12:18145:x1875734050270720:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788840019.472759:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840019.472799:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647843000/0xad5b343a26574b19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ed0 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.472825:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843000/0xad5b343a26574b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ed0 expref: 13 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.472835:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647843000/0xad5b343a26574b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ed0 expref: 13 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.472844:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843000, rc 0) 00000100:00100000:2.0:1788840019.472897:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18145:x1875734050270720:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 154us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840019.472903:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:3.0:1788840019.475590:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840019.476000:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050270848 00000100:00100000:2.0:1788840019.476015:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050270848 00000100:00100000:0.0:1788840019.476257:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:0.0:1788840019.476270:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18145:x1875734050270848:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788840019.476449:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18145:x1875734050270848:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 182us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840019.476457:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:0.0:1788840019.478556:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840019.478668:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050270976 00000100:00100000:1.0:1788840019.478678:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050270976 00000100:00100000:1.0:1788840019.478738:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:1.0:1788840019.478748:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18145:x1875734050270976:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.478912:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:176971ca-bf30-437e-868a-3adf0e6b2af5+13:18145:x1875734050270976:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 164us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.478926:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 154 00000040:00080000:0.0:1788840019.519545:0:22712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788840019.548385:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840019.548572:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050271104 00000100:00100000:2.0:1788840019.548582:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050271104 00000100:00100000:2.0:1788840019.548665:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:2.0:1788840019.548676:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+6:18769:x1875734050271104:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788840019.548697:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840019.548717:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ed7 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.548800:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574b27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.548824:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574b27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.548834:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574b27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.548849:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.548856:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.548864:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.548945:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26574b35 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.548954:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26574b35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.548961:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26574b35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788840019.548991:0:22677:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788840019.548994:0:22677:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788840019.549032:0:22677:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26574b35 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549042:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574b27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549059:0:22677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574b27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549066:0:22677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574b27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549071:0:22677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788840019.549076:0:22677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574b27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549084:0:22677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574b27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549096:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800e00) 00010000:00010000:2.0:1788840019.549099:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788840019.549104:0:22677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574b27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549110:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574b27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549139:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549145:0:22677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549151:0:22677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549156:0:22677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788840019.549165:0:22677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549171:0:22677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549179:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ab646800200) 00010000:00010000:2.0:1788840019.549182:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788840019.549185:0:22677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549191:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549221:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ed7 expref: 8 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549233:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26574b35 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ed7 expref: 7 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.549240:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab646800a00) 00010000:00010000:2.0:1788840019.549242:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788840019.549245:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843a00, rc 0) 00000100:00100000:2.0:1788840019.549308:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+7:18769:x1875734050271104:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 634us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840019.549315:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00080000:0.0:1788840019.549404:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788840019.552535:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840019.552654:0:22687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050271232 00000100:00100000:2.0:1788840019.552663:0:22687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050271232 00000100:00100000:2.0:1788840019.552767:0:22687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1788840019.552803:0:22687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:41172893-7edf-4e98-bf08-ce61943bc35d+7:18769:x1875734050271232:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788840019.552891:0:22687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:41172893-7edf-4e98-bf08-ce61943bc35d+7:18769:x1875734050271232:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 91us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840019.552898:0:22687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788840019.563471:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840019.563549:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050271488 00000100:00100000:2.0:1788840019.563568:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050271488 00000100:00100000:2.0:1788840019.563629:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788840019.563639:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+7:18769:x1875734050271488:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788840019.563661:0:23418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840019.563681:0:23418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574b3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ede expref: -99 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.563754:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574b43 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.563822:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574b43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.563835:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574b43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.563849:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b4a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.563855:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.563860:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.563982:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b51 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564004:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564011:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788840019.564021:0:23418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788840019.564350:0:23418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574b43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564358:0:23418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574b43 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564365:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574b43 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564370:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788840019.564374:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574b43 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564381:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574b43 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564392:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab646800a00) 00010000:00010000:2.0:1788840019.564396:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788840019.564400:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574b43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564406:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574b43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564417:0:23418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564430:0:23418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b4a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564437:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564442:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788840019.564445:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564452:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b4a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564460:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ab646800200) 00010000:00010000:2.0:1788840019.564462:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788840019.564465:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b4a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.564471:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26574b4a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.565740:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574b3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ede expref: 10 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.565765:0:23418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842800/0xad5b343a26574b51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ede expref: 9 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.565805:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab646800000) 00010000:00010000:1.0:1788840019.565807:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840019.565811:0:23418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842800, rc 0) 00000100:00100000:1.0:1788840019.565882:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+9:18769:x1875734050271488:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2243us (2419us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788840019.565892:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:3.0:1788840019.583603:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 10000000:01000000:0.0:1788840019.588128:0:22674:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788840019.588136:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab7477ad800 from 13 10000000:01000000:0.0:1788840019.588142:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788840019.588192:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23600/0xad5b343a26574b5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.588204:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23600/0xad5b343a26574b5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.588217:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23600/0xad5b343a26574b5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840019.588245:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788840019.588313:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840019.588368:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78540 going to sleep for 11 seconds 00000100:00100000:2.0:1788840019.588496:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050271616 00000100:00100000:2.0:1788840019.588505:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050271616 00000100:00100000:2.0:1788840019.588585:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788840019.588596:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+9:18769:x1875734050271616:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788840019.588698:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+9:18769:x1875734050271616:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 105us (5104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840019.588705:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788840019.589481:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060862336 00000100:00100000:1.0:1788840019.589489:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060862336 00000100:00100000:1.0:1788840019.589556:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788840019.589574:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+20:22674:x1875734060862336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788840019.589588:0:22670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788840019.589603:0:22670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab746e4e200/0xad5b343a26574b66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574b5f expref: -99 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.589631:0:22670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab746e4e200/0xad5b343a26574b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574b5f expref: 21 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.589644:0:22670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab746e4e200/0xad5b343a26574b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574b5f expref: 21 pid: 22670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.589671:0:22670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4e200, rc 0) 00000100:00100000:1.0:1788840019.589737:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:22674:x1875734060862336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.589744:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788840019.589926:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788840019.589943:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23600/0xad5b343a26574b5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b66 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.589953:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23600/0xad5b343a26574b5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574b66 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840019.590018:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788840019.590048:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840019.590081:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78540 going to sleep for 11 seconds 00000100:00100000:1.0:1788840019.590291:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060862464 00000100:00100000:1.0:1788840019.590296:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060862464 00000100:00100000:1.0:1788840019.590330:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788840019.590337:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:22674:x1875734060862464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.590456:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:22674:x1875734060862464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.590463:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788840019.590680:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788840019.590722:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788840019.590763:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840019.590832:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746a52300 going to sleep for 11 seconds 00000100:00100000:2.0:1788840019.590920:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060862592 00000100:00100000:2.0:1788840019.590930:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060862592 00000100:00100000:2.0:1788840019.590967:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788840019.590974:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:22674:x1875734060862592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788840019.591076:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:22674:x1875734060862592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840019.591084:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788840019.591412:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788840019.592047:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840019.592127:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050271744 00000100:00100000:1.0:1788840019.592133:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050271744 00000100:00100000:1.0:1788840019.592197:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:1.0:1788840019.592206:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+5:18769:x1875734050271744:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788840019.592836:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1788840019.593793:0:22678:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1555us 00000040:00080000:2.0:1788840019.594373:0:25720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788840019.594676:0:22674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788840019.594699:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788840019.594710:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23600/0xad5b343a26574b5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b66 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.594721:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23600/0xad5b343a26574b5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b66 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788840019.594730:0:22674:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788840019.594733:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab777c24000 from 13 10000000:01000000:0.0:1788840019.594735:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788840019.594767:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23800/0xad5b343a26574b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.594804:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23800/0xad5b343a26574b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.594813:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23800/0xad5b343a26574b6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840019.594856:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788840019.594923:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840019.594963:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788840019.595684:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060862720 00000100:00100000:2.0:1788840019.595692:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060862720 00000100:00100000:2.0:1788840019.595735:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788840019.595746:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+21:22674:x1875734060862720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788840019.595761:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840019.595790:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647842c00/0xad5b343a26574b74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574b6d expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.595814:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842c00/0xad5b343a26574b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574b6d expref: 22 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.595824:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647842c00/0xad5b343a26574b74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574b6d expref: 22 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.595831:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842c00, rc 0) 00000100:00100000:2.0:1788840019.596664:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:22674:x1875734060862720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 917us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840019.596683:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788840019.604901:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788840019.604929:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23800/0xad5b343a26574b6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b74 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.604942:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23800/0xad5b343a26574b6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574b74 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840019.605020:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788840019.605077:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840019.605134:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746a52300 going to sleep for 11 seconds 00000100:00100000:0.0:1788840019.605282:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060862848 00000100:00100000:0.0:1788840019.605289:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060862848 00000100:00100000:0.0:1788840019.605336:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788840019.605346:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:22674:x1875734060862848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788840019.605453:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:22674:x1875734060862848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840019.605461:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788840019.606466:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788840019.606511:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788840019.606662:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840019.606692:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746a52300 going to sleep for 11 seconds 00000100:00100000:0.0:1788840019.606766:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060862976 00000100:00100000:0.0:1788840019.606796:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060862976 00000100:00100000:0.0:1788840019.606836:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788840019.606844:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:22674:x1875734060862976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788840019.606945:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:22674:x1875734060862976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840019.606952:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788840019.607078:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060862976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788840019.608710:0:25722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788840019.614032:0:22674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788840019.614067:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788840019.614079:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23800/0xad5b343a26574b6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b74 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.614093:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab77dc23800/0xad5b343a26574b6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b74 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788840019.614104:0:22674:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788840019.614113:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab7467ba000 from 13 10000000:01000000:0.0:1788840019.614116:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788840019.614164:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab77dc22800/0xad5b343a26574b7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.614173:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab77dc22800/0xad5b343a26574b7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.614182:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab77dc22800/0xad5b343a26574b7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840019.614209:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788840019.614271:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840019.614471:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5480 going to sleep for 11 seconds 00000100:00100000:0.0:1788840019.617806:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+5:18769:x1875734050271744:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 25563us (25722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840019.617820:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:1.0:1788840019.619165:0:22672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060863104 00000100:00100000:1.0:1788840019.619176:0:22672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060863104 00000100:00100000:1.0:1788840019.619233:0:22672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788840019.619242:0:22672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+22:22674:x1875734060863104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788840019.619257:0:22672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788840019.619275:0:22672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab746e4f400/0xad5b343a26574b82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574b7b expref: -99 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.619301:0:22672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab746e4f400/0xad5b343a26574b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574b7b expref: 23 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.619326:0:22672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab746e4f400/0xad5b343a26574b82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574b7b expref: 23 pid: 22672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.619335:0:22672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4f400, rc 0) 00000100:00100000:1.0:1788840019.619397:0:22672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:22674:x1875734060863104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (5126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.619404:0:22672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788840019.619456:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483dc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788840019.619474:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab77dc22800/0xad5b343a26574b7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b82 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.619483:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab77dc22800/0xad5b343a26574b7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574b82 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840019.619577:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.619609:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840019.619638:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647af2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788840019.619652:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060863232 00000100:00100000:1.0:1788840019.619656:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060863232 00000100:00100000:1.0:1788840019.619678:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788840019.619685:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:22674:x1875734060863232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.619804:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:22674:x1875734060863232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.619811:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788840019.619844:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.619881:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.619919:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840019.619938:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647af2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788840019.619948:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060863360 00000100:00100000:1.0:1788840019.619951:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060863360 00000100:00100000:1.0:1788840019.619968:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788840019.619973:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:22674:x1875734060863360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.620047:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:22674:x1875734060863360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.620053:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788840019.620082:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788840019.620728:0:25723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788840019.620801:0:22674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788840019.620816:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788840019.620823:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab77dc22800/0xad5b343a26574b7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b82 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.620834:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab77dc22800/0xad5b343a26574b7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b82 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788840019.620844:0:22674:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788840019.620846:0:22674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab781e72000 from 13 10000000:01000000:1.0:1788840019.620849:0:22674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788840019.620870:0:22674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e000/0xad5b343a26574b89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.620878:0:22674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e000/0xad5b343a26574b89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.620893:0:22674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e000/0xad5b343a26574b89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840019.620909:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.620941:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840019.620963:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f96240 going to sleep for 11 seconds 00000100:00100000:1.0:1788840019.620974:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060863488 00000100:00100000:1.0:1788840019.620978:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060863488 00000100:00100000:1.0:1788840019.621001:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788840019.621006:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+23:22674:x1875734060863488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788840019.621014:0:22669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788840019.621024:0:22669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab746e4ec00/0xad5b343a26574b90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26574b89 expref: -99 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.621040:0:22669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab746e4ec00/0xad5b343a26574b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26574b89 expref: 24 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.621048:0:22669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab746e4ec00/0xad5b343a26574b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26574b89 expref: 24 pid: 22669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.621055:0:22669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4ec00, rc 0) 00000100:00100000:1.0:1788840019.621083:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:22674:x1875734060863488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.621089:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788840019.621120:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788840019.621131:0:22674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e000/0xad5b343a26574b89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b90 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.621145:0:22674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e000/0xad5b343a26574b89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26574b90 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840019.621187:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.621210:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840019.621223:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f96240 going to sleep for 11 seconds 00000100:00100000:1.0:1788840019.621234:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060863616 00000100:00100000:1.0:1788840019.621237:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060863616 00000100:00100000:1.0:1788840019.621257:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788840019.621262:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:22674:x1875734060863616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.621336:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:22674:x1875734060863616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.621343:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788840019.621370:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.621392:0:22674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.621424:0:22674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840019.621437:0:22674:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f96240 going to sleep for 11 seconds 00000100:00100000:1.0:1788840019.621446:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060863744 00000100:00100000:1.0:1788840019.621449:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060863744 00000100:00100000:1.0:1788840019.621467:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788840019.621472:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:22674:x1875734060863744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788840019.621553:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641a20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:22674:x1875734060863744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.621559:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788840019.621596:0:22674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:22674:1875734060863744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788840019.622280:0:25724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788840019.622319:0:22674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788840019.622333:0:22674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788840019.622340:0:22674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e000/0xad5b343a26574b89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b90 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.622349:0:22674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab746e4e000/0xad5b343a26574b89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26574b90 expref: -99 pid: 22674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840019.623092:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840019.623684:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050271872 00000100:00100000:1.0:1788840019.623693:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050271872 00000100:00100000:1.0:1788840019.623798:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1788840019.623808:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+9:18775:x1875734050271872:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788840019.623825:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788840019.623842:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e600/0xad5b343a26574b97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ee5 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.623902:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574b9e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.623917:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574b9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.623928:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574b9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.623974:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574ba5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.623999:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624006:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624042:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574b9e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624049:0:22677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574b9e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624055:0:22677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574b9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624060:0:22677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4e400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840019.624064:0:22677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574b9e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624071:0:22677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574b9e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624082:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800e00) 00010000:00010000:1.0:1788840019.624085:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840019.624089:0:22677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574b9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624095:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574b9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624104:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624115:0:22677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574ba5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624122:0:22677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624127:0:22677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4fa00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840019.624130:0:22677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624135:0:22677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574ba5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624142:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ab74860b600) 00010000:00010000:1.0:1788840019.624144:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840019.624147:0:22677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574ba5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624152:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574ba5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624183:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e600/0xad5b343a26574b97 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ee5 expref: 10 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624193:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800e00) 00010000:00010000:1.0:1788840019.624195:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840019.624198:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e600/0xad5b343a26574b97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ee5 expref: 10 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.624217:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4e600, rc 0) 00000100:00100000:1.0:1788840019.624267:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+9:18775:x1875734050271872:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 461us (1180us total) trans 0 rc 301/301 00000100:00100000:1.0:1788840019.624275:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788840019.630262:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840019.630350:0:22685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050272000 00000100:00100000:2.0:1788840019.630366:0:22685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050272000 00000100:00100000:2.0:1788840019.630414:0:22685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788840019.630423:0:22685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:41172893-7edf-4e98-bf08-ce61943bc35d+9:18775:x1875734050272000:12345-192.168.203.52@tcp:700:lfs.0 00000100:00100000:2.0:1788840019.630495:0:22685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:41172893-7edf-4e98-bf08-ce61943bc35d+9:18775:x1875734050272000:12345-192.168.203.52@tcp:700:lfs.0 Request processed in 73us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840019.630503:0:22685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1788840019.636759:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840019.637171:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050272256 00000100:00100000:1.0:1788840019.637182:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050272256 00000100:00100000:1.0:1788840019.637244:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788840019.637255:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+9:18775:x1875734050272256:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:1.0:1788840019.637308:0:23418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788840019.637333:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ac5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74e52 expref: 9 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.637351:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800e00) 00010000:00010000:1.0:1788840019.637356:0:23418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788840019.637406:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.637419:0:23418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ec2 expref: 5 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.637429:0:23418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.637458:0:23418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ec2 expref: 5 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.637470:0:23418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ec2 expref: 5 pid: 22677 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840019.637498:0:23418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23418:1875734060863872:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788840019.637589:0:23418:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f96a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788840019.643060:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840019.643127:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050272384 00000100:00100000:0.0:1788840019.643145:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050272384 00010000:00010000:0.0:1788840019.643192:0:22664:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ec2 expref: 6 pid: 22677 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840019.643232:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1788840019.643243:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2390:x1875734050272384:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788840019.643268:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788840019.643275:0:22664:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ec2 expref: 6 pid: 22677 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.643307:0:22664:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ec2 expref: 6 pid: 22677 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.643330:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800e00) 00010000:00010000:0.0:1788840019.643335:0:22664:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.643344:0:22664:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.643351:0:22664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.643370:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788840019.643415:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:2390:x1875734050272384:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 173us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840019.643422:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00080000:2.0:1788840019.643475:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788840019.643912:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fc00/0xad5b343a26574b04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ec2 expref: 5 pid: 22677 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840019.643936:0:23418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23418:1875734060863872:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788840019.643955:0:23418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.643963:0:23418:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.643968:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.643990:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.643999:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.644007:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649289:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649313:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649325:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788840019.649342:0:23418:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcf18469 reply state 00000000cfe3c20e transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649365:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649373:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ab647852800) 00010000:00010000:3.0:1788840019.649375:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788840019.649380:0:23418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788840019.649386:0:23418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788840019.649394:0:23418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649401:0:23418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649409:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649415:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4e800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788840019.649419:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649427:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649437:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800e00) 00010000:00010000:3.0:1788840019.649440:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788840019.649443:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649449:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bac lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788840019.649479:0:23418:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcf18469 reply state 00000000cfe3c20e transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649488:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.649495:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ab647852700) 00010000:00010000:3.0:1788840019.649497:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788840019.649499:0:23418:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788840019.649616:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+10:18775:x1875734050272256:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 12359us (12863us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788840019.649625:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788840019.743078:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840019.743314:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050272512 00000100:00100000:2.0:1788840019.743325:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050272512 00000100:00100000:2.0:1788840019.743391:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1788840019.743402:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+10:18783:x1875734050272512:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:2.0:1788840019.743427:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840019.743451:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574bc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74eec expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.743531:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574bc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.743546:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.743556:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788840019.743843:0:22676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788840019.743847:0:22676:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788840019.743960:0:22676:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.743987:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574bc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74eec expref: 12 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.744021:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26574bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74eec expref: 11 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.744029:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800200) 00010000:00010000:2.0:1788840019.744031:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788840019.744035:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843200, rc 0) 00000100:00100000:2.0:1788840019.744154:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+11:18783:x1875734050272512:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 753us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840019.744162:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1788840019.804142:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840019.804228:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050272640 00000100:00100000:3.0:1788840019.804239:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050272640 00000100:00100000:3.0:1788840019.804307:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788840019.804318:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+5:18784:x1875734050272640:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788840019.804337:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788840019.804358:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574bcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ef3 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.804423:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574bd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.804440:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.804451:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788840019.804528:0:22678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788840019.804532:0:22678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788840019.804551:0:22678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.804573:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574bcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ef3 expref: 7 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.804592:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ef3 expref: 6 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.804601:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800200) 00010000:00010000:3.0:1788840019.804604:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788840019.804607:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959600, rc 0) 00000100:00100000:3.0:1788840019.804705:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:18784:x1875734050272640:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 390us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840019.804712:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1788840019.814125:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840019.814229:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050272768 00000100:00100000:1.0:1788840019.814238:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050272768 00000100:00100000:1.0:1788840019.814300:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:1.0:1788840019.814311:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+6:18784:x1875734050272768:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788840019.814332:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788840019.814353:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e600/0xad5b343a26574bdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74efa expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814430:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574be4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814444:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574be4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814454:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574be4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814465:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574beb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814473:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814479:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814749:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bf2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814758:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bf2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814765:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bf2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788840019.814902:0:22677:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788840019.814906:0:22677:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788840019.814929:0:22677:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bf2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814941:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574be4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814948:0:22677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574be4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814954:0:22677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574be4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814961:0:22677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4fa00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840019.814964:0:22677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574be4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814972:0:22677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574be4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.814983:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800200) 00010000:00010000:1.0:1788840019.814993:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840019.814999:0:22677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574be4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.815005:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574be4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.815020:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574beb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.815026:0:22677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574beb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.815032:0:22677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574beb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.815037:0:22677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4e400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840019.815040:0:22677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574beb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.815046:0:22677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574beb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.815054:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ab647852700) 00010000:00010000:1.0:1788840019.815057:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840019.815059:0:22677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574beb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.815065:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574beb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.815092:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e600/0xad5b343a26574bdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74efa expref: 8 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.815115:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bf2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74efa expref: 7 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.815121:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ab647852800) 00010000:00010000:1.0:1788840019.815123:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788840019.815125:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4e800, rc 0) 00000100:00100000:1.0:1788840019.815236:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+7:18784:x1875734050272768:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 926us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.815244:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1788840019.820001:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840019.820097:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050272896 00000100:00100000:3.0:1788840019.820107:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050272896 00000100:00100000:3.0:1788840019.820222:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1788840019.820232:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+5:18784:x1875734050272896:12345-192.168.203.52@tcp:900:lfs.0 00000100:00100000:3.0:1788840019.820319:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+5:18784:x1875734050272896:12345-192.168.203.52@tcp:900:lfs.0 Request processed in 87us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840019.820327:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00080000:2.0:1788840019.820832:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788840019.824171:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840019.826529:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050273152 00000100:00100000:3.0:1788840019.826542:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050273152 00000100:00100000:0.0:1788840019.827031:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:0.0:1788840019.827043:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+7:18784:x1875734050273152:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788840019.827063:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788840019.827085:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23e00/0xad5b343a26574bf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f01 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788840019.827182:0:22678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788840019.827279:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23e00/0xad5b343a26574bf9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f01 expref: 9 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.827313:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800200) 00010000:00010000:0.0:1788840019.827316:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788840019.827322:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23e00/0xad5b343a26574bf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f01 expref: 9 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.827336:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab77dc23e00, rc 0) 00000100:00100000:0.0:1788840019.827411:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+8:18784:x1875734050273152:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 371us (3250us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1788840019.827419:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:1.0:1788840019.830915:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840019.831122:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050273408 00000100:00100000:2.0:1788840019.831131:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050273408 00000100:00100000:2.0:1788840019.831183:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1788840019.831193:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+8:18784:x1875734050273408:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:2.0:1788840019.831245:0:22676:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788840019.831270:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574bf2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74efa expref: 8 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.831289:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ab647852800) 00010000:00010000:2.0:1788840019.831294:0:22676:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788840019.831313:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.831343:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.831353:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788840019.831535:0:22676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a525bee reply state 00000000ecbf0ff1 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.831548:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.831555:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ab647852800) 00010000:00010000:2.0:1788840019.831557:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788840019.831569:0:22676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788840019.831577:0:22676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788840019.832110:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+9:18784:x1875734050273408:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 916us (1200us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788840019.832117:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1788840019.835394:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840019.835663:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050273664 00000100:00100000:0.0:1788840019.835674:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050273664 00000100:00100000:0.0:1788840019.835873:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1788840019.835885:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+9:18784:x1875734050273664:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788840019.836092:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+10:18784:x1875734050273664:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 210us (707us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788840019.836100:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788840019.839634:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840019.839741:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050273920 00000100:00100000:1.0:1788840019.839751:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050273920 00000100:00100000:1.0:1788840019.839832:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788840019.839842:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+10:18784:x1875734050273920:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788840019.839865:0:23418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788840019.839885:0:23418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574c0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f08 expref: -99 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.839966:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574c15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.839981:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.839992:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840015:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574c1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840023:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840030:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788840019.840129:0:23418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788840019.840198:0:23418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840205:0:23418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574c15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840211:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574c15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840216:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4fa00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840019.840220:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574c15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840226:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574c15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840238:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800200) 00010000:00010000:1.0:1788840019.840241:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840019.840244:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574c15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840259:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574c15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840270:0:23418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840276:0:23418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574c1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840281:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574c1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840286:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4f800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840019.840289:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574c1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840294:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574c1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840300:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ab647852700) 00010000:00010000:1.0:1788840019.840303:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840019.840305:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574c1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840310:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574c1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840338:0:23418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574c0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f08 expref: 12 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840358:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800200) 00010000:00010000:1.0:1788840019.840360:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788840019.840364:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574c0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f08 expref: 12 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.840372:0:23418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4e400, rc 0) 00000100:00100000:1.0:1788840019.840432:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+11:18784:x1875734050273920:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 592us (807us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1788840019.840439:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788840019.842949:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840019.843066:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050274048 00000100:00100000:2.0:1788840019.843078:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050274048 00000100:00100000:2.0:1788840019.843137:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1788840019.843147:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+11:18784:x1875734050274048:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788840019.843170:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840019.843191:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574c2a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f0f expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.843284:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.843320:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.843331:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788840019.843360:0:22677:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788840019.843363:0:22677:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788840019.843382:0:22677:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.843408:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574c2a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f0f expref: 13 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.843425:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f0f expref: 12 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.843433:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ab647852800) 00010000:00010000:2.0:1788840019.843436:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788840019.843440:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843800, rc 0) 00000100:00100000:2.0:1788840019.843499:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+12:18784:x1875734050274048:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 353us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840019.843506:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1788840019.849956:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840019.850076:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050274176 00000100:00100000:1.0:1788840019.850085:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050274176 00000100:00100000:1.0:1788840019.850181:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788840019.850192:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+12:18784:x1875734050274176:12345-192.168.203.52@tcp:37:lfs.0 00000100:00100000:1.0:1788840019.855187:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+12:18784:x1875734050274176:12345-192.168.203.52@tcp:37:lfs.0 Request processed in 4986us (5228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.855200:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788840019.859400:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840019.859500:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050274432 00000100:00100000:0.0:1788840019.859510:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050274432 00000100:00100000:0.0:1788840019.859684:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788840019.859696:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+12:18784:x1875734050274432:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788840019.859984:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+13:18784:x1875734050274432:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 289us (593us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788840019.859992:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788840019.932246:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840019.932355:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050274560 00000100:00100000:0.0:1788840019.932381:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050274560 00000100:00100000:0.0:1788840019.932444:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1788840019.932455:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+11:18790:x1875734050274560:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788840019.932475:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788840019.932497:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23c00/0xad5b343a26574c38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f16 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932569:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574c3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932584:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574c3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932595:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574c3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932608:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22400/0xad5b343a26574c46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932616:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22400/0xad5b343a26574c46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932624:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22400/0xad5b343a26574c46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932704:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22a00/0xad5b343a26574c4d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932714:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22a00/0xad5b343a26574c4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932721:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22a00/0xad5b343a26574c4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788840019.932763:0:22678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788840019.932767:0:22678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788840019.932841:0:22678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22a00/0xad5b343a26574c4d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932854:0:22678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574c3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932860:0:22678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574c3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932867:0:22678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574c3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932874:0:22678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc22600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788840019.932878:0:22678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574c3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932886:0:22678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574c3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932897:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800200) 00010000:00010000:0.0:1788840019.932900:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788840019.932905:0:22678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574c3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932910:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574c3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932924:0:22678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22400/0xad5b343a26574c46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932940:0:22678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22400/0xad5b343a26574c46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932946:0:22678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22400/0xad5b343a26574c46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932950:0:22678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc22400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788840019.932953:0:22678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22400/0xad5b343a26574c46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932959:0:22678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22400/0xad5b343a26574c46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932966:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ab647852700) 00010000:00010000:0.0:1788840019.932969:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788840019.932971:0:22678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22400/0xad5b343a26574c46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.932976:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22400/0xad5b343a26574c46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.933003:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23c00/0xad5b343a26574c38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f16 expref: 13 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.933016:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22a00/0xad5b343a26574c4d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f16 expref: 12 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840019.933022:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ab647852800) 00010000:00010000:0.0:1788840019.933024:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788840019.933032:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab77dc22a00, rc 0) 00000100:00100000:0.0:1788840019.933083:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+12:18790:x1875734050274560:12345-192.168.203.52@tcp:101:bash.0 Request processed in 630us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840019.933091:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788840019.936295:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840019.938992:0:22688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050274688 00000100:00100000:1.0:1788840019.939006:0:22688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050274688 00000100:00100000:1.0:1788840019.939160:0:22688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788840019.939173:0:22688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41172893-7edf-4e98-bf08-ce61943bc35d+5:18790:x1875734050274688:12345-192.168.203.52@tcp:900:bash.0 00000100:00100000:1.0:1788840019.939272:0:22688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41172893-7edf-4e98-bf08-ce61943bc35d+5:18790:x1875734050274688:12345-192.168.203.52@tcp:900:bash.0 Request processed in 101us (2985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.939279:0:22688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788840019.946705:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840019.946802:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050274944 00000100:00100000:3.0:1788840019.946811:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050274944 00000100:00100000:3.0:1788840019.946870:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1788840019.946880:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+12:18790:x1875734050274944:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788840019.946901:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788840019.946932:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574c54 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f1d expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.947037:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.947052:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f0f expref: 12 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.947060:0:22676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.947090:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f0f expref: 12 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.947103:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f0f expref: 12 pid: 22677 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840019.947116:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22676:1875734060864000:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788840019.947195:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746ddcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788840019.951786:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840019.952021:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22676:1875734060864000:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788840019.952051:0:22676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840019.952075:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050275072 00000100:00100000:1.0:1788840019.952084:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050275072 00010000:00010000:1.0:1788840019.952122:0:22663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f0f expref: 13 pid: 22677 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840019.952211:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1788840019.952221:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+13:2390:x1875734050275072:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788840019.952237:0:22663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788840019.952245:0:22663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f0f expref: 13 pid: 22677 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.952259:0:22663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f0f expref: 13 pid: 22677 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.952283:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574c31 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f0f expref: 13 pid: 22677 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.952299:0:22663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ab647852800) 00010000:00010000:1.0:1788840019.952306:0:22663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.952314:0:22663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.952321:0:22663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840019.952348:0:22663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788840019.952398:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+12:2390:x1875734050275072:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 178us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840019.952411:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00010000:00010000:3.0:1788840019.952462:0:22676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.952470:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.952550:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.952560:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.952568:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953039:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959c00/0xad5b343a26574c69 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953049:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959c00/0xad5b343a26574c69 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953056:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959c00/0xad5b343a26574c69 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788840019.953066:0:22676:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788840019.953092:0:22676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953099:0:22676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953105:0:22676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953117:0:22676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788840019.953121:0:22676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953128:0:22676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953137:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ab647852800) 00010000:00010000:3.0:1788840019.953140:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788840019.953144:0:22676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953150:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c5b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788840019.953162:0:22676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8e236f6 reply state 00000000356efef0 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953173:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953179:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8ab647852e00) 00010000:00010000:3.0:1788840019.953182:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788840019.953185:0:22676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788840019.953216:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574c54 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f1d expref: 15 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953229:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959c00/0xad5b343a26574c69 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f1d expref: 14 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840019.953246:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:3.0:1788840019.953248:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788840019.953250:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959c00, rc 0) 00000100:00100000:3.0:1788840019.953300:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+15:18790:x1875734050274944:12345-192.168.203.52@tcp:101:bash.0 Request processed in 6422us (6604us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788840019.953307:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:0.0:1788840019.963345:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840019.963452:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050275200 00000100:00100000:2.0:1788840019.963462:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050275200 00000100:00100000:2.0:1788840019.963621:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:2.0:1788840019.963632:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+15:18790:x1875734050275200:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788840019.963759:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840019.963814:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574c77 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f24 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.963878:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.963892:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.963903:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788840019.963946:0:22678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788840019.963949:0:22678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788840019.963967:0:22678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.963977:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.963999:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574c77 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f24 expref: 17 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.964016:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f24 expref: 16 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840019.964041:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:2.0:1788840019.964044:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788840019.964048:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843e00, rc 0) 00000100:00100000:2.0:1788840019.964098:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+16:18790:x1875734050275200:12345-192.168.203.52@tcp:101:bash.0 Request processed in 469us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840019.964105:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1788840019.966405:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840019.966492:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050275456 00000100:00100000:1.0:1788840019.966501:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050275456 00000100:00100000:1.0:1788840019.966571:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788840019.966581:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+16:18790:x1875734050275456:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1788840019.966900:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+17:18790:x1875734050275456:12345-192.168.203.52@tcp:35:bash.0 Request processed in 319us (502us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1788840019.966907:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788840020.041898:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840020.042008:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050275712 00000100:00100000:2.0:1788840020.042018:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050275712 00000100:00100000:2.0:1788840020.042080:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:2.0:1788840020.042091:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+17:18800:x1875734050275712:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788840020.042115:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840020.042136:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574c85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f2b expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788840020.042245:0:22677:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788840020.042339:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574c85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f2b expref: 19 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.042353:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646800200) 00010000:00010000:2.0:1788840020.042356:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788840020.042362:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574c85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f2b expref: 19 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.042376:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843600, rc 0) 00000100:00100000:2.0:1788840020.042444:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+18:18800:x1875734050275712:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 355us (555us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1788840020.042466:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:3.0:1788840020.046632:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840020.046728:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050275968 00000100:00100000:1.0:1788840020.046738:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050275968 00000100:00100000:1.0:1788840020.046829:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788840020.046839:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+18:18800:x1875734050275968:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788840020.047058:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+19:18800:x1875734050275968:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 219us (435us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788840020.047066:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788840020.086021:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840020.086115:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050276224 00000100:00100000:3.0:1788840020.086125:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050276224 00000100:00100000:3.0:1788840020.086195:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:3.0:1788840020.086205:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+19:18803:x1875734050276224:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788840020.086230:0:23418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788840020.086251:0:23418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574c93 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f32 expref: -99 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.086358:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c9a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.086372:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c9a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.086384:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c9a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788840020.086395:0:23418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788840020.086498:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574c93 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f32 expref: 22 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.086552:0:23418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c9a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f32 expref: 21 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.086560:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:3.0:1788840020.086563:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788840020.086566:0:23418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959e00, rc 0) 00000100:00100000:3.0:1788840020.086630:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+21:18803:x1875734050276224:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 426us (618us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788840020.086818:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1788840020.090339:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840020.090429:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050276352 00000100:00100000:1.0:1788840020.090438:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050276352 00000100:00100000:1.0:1788840020.090494:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:1.0:1788840020.090510:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+21:18803:x1875734050276352:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1788840020.090578:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574ca8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.090603:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574ca8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.090627:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574ca8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.090665:0:22677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574ca8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.090672:0:22677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574ca8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.090679:0:22677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574ca8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.090684:0:22677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4f800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840020.090688:0:22677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574ca8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.090696:0:22677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574ca8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.090706:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:1.0:1788840020.090709:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788840020.090713:0:22677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574ca8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.090719:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f800/0xad5b343a26574ca8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840020.090817:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+21:18803:x1875734050276352:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 314us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840020.090823:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1788840020.092854:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840020.093025:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050276480 00000100:00100000:3.0:1788840020.093035:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050276480 00000100:00100000:3.0:1788840020.093097:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1788840020.093108:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41172893-7edf-4e98-bf08-ce61943bc35d+21:2389:x1875734050276480:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788840020.093123:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788840020.093218:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574c9a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f32 expref: 21 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.093235:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:3.0:1788840020.093239:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788840020.093379:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41172893-7edf-4e98-bf08-ce61943bc35d+20:2389:x1875734050276480:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 272us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840020.093387:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788840020.098050:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840020.098211:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050276736 00000100:00100000:1.0:1788840020.098221:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050276736 00000100:00100000:1.0:1788840020.098280:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788840020.098290:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+20:18803:x1875734050276736:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788840020.098608:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+21:18803:x1875734050276736:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 318us (563us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1788840020.098616:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00010000:00010000:1.0:1788840020.223007:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788840020.352665:0:23431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788840020.459458:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840020.459605:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050276992 00000100:00100000:3.0:1788840020.459615:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050276992 00000100:00100000:3.0:1788840020.460026:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1788840020.460053:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+21:18835:x1875734050276992:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1788840020.460080:0:23418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788840020.460103:0:23418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574caf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f39 expref: -99 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.460204:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574cb6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.460230:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574cb6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.460242:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574cb6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788840020.460253:0:23418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788840020.460392:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574caf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f39 expref: 24 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.460410:0:23418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574cb6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f39 expref: 23 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.460420:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:3.0:1788840020.460423:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788840020.460427:0:23418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958400, rc 0) 00000100:00100000:3.0:1788840020.460497:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+23:18835:x1875734050276992:12345-192.168.203.52@tcp:101:cat.0 Request processed in 447us (1048us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1788840020.465864:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:0.0:1788840020.466301:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840020.466433:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050277120 00000100:00100000:3.0:1788840020.466442:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050277120 00000100:00100000:3.0:1788840020.466525:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1788840020.466531:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840020.466541:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41172893-7edf-4e98-bf08-ce61943bc35d+23:2390:x1875734050277120:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788840020.466559:0:22662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788840020.466584:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574cb6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f39 expref: 23 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.466605:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:3.0:1788840020.466611:0:22662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788840020.466671:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41172893-7edf-4e98-bf08-ce61943bc35d+22:2390:x1875734050277120:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 134us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840020.466678:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788840020.466964:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050277376 00000100:00100000:2.0:1788840020.466969:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050277376 00000100:00100000:2.0:1788840020.467002:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788840020.467012:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41172893-7edf-4e98-bf08-ce61943bc35d+22:18835:x1875734050277376:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:2.0:1788840020.467819:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41172893-7edf-4e98-bf08-ce61943bc35d+23:18835:x1875734050277376:12345-192.168.203.52@tcp:35:cat.0 Request processed in 806us (1298us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788840020.467827:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788840020.526701:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840020.526863:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050277632 00000100:00100000:1.0:1788840020.526874:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050277632 00000100:00100000:1.0:1788840020.526974:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1788840020.526986:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+23:18841:x1875734050277632:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:1.0:1788840020.527012:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788840020.527033:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574cc4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f40 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.527270:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f600/0xad5b343a26574ccb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.527285:0:22677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959c00/0xad5b343a26574c69 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f1d expref: 24 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.527294:0:22677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f24 expref: 24 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.527302:0:22677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f600/0xad5b343a26574ccb lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.527356:0:22677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f24 expref: 24 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.527370:0:22677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f24 expref: 24 pid: 22678 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840020.527385:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22677:1875734060864128:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788840020.527617:0:22677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959c00/0xad5b343a26574c69 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f1d expref: 24 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.527627:0:22677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959c00/0xad5b343a26574c69 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f1d expref: 24 pid: 22676 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840020.528373:0:22677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22677:1875734060864256:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788840020.528605:0:22677:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f96840 going to sleep for 11 seconds 00000100:00100000:1.0:1788840020.534984:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22677:1875734060864128:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788840020.536388:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840020.537724:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050277760 00000100:00100000:1.0:1788840020.537736:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050277760 00010000:00010000:1.0:1788840020.537798:0:23433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f24 expref: 25 pid: 22678 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840020.537893:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788840020.537904:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41172893-7edf-4e98-bf08-ce61943bc35d+25:2389:x1875734050277760:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788840020.537931:0:23433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788840020.537938:0:23433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f24 expref: 25 pid: 22678 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.537966:0:23433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f24 expref: 25 pid: 22678 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.537989:0:23433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574c7e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f24 expref: 25 pid: 22678 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.538006:0:23433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:1.0:1788840020.538012:0:23433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f600/0xad5b343a26574ccb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.538020:0:23433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f600/0xad5b343a26574ccb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.538026:0:23433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788840020.538093:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41172893-7edf-4e98-bf08-ce61943bc35d+24:2389:x1875734050277760:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 191us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840020.538101:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788840020.543208:0:22677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22677:1875734060864256:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788840020.543242:0:22677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f600/0xad5b343a26574ccb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840020.544317:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840020.545029:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050277888 00000100:00100000:1.0:1788840020.545040:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050277888 00010000:00010000:1.0:1788840020.545090:0:22662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959c00/0xad5b343a26574c69 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f1d expref: 24 pid: 22676 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840020.545160:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788840020.545198:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41172893-7edf-4e98-bf08-ce61943bc35d+24:2390:x1875734050277888:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788840020.545214:0:22662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788840020.545245:0:22662:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959c00/0xad5b343a26574c69 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f1d expref: 24 pid: 22676 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.545275:0:22662:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959c00/0xad5b343a26574c69 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f1d expref: 24 pid: 22676 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.545300:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959c00/0xad5b343a26574c69 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f1d expref: 24 pid: 22676 timeout: 775 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.545315:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:1.0:1788840020.545321:0:22662:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f600/0xad5b343a26574ccb lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.545331:0:22662:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f600/0xad5b343a26574ccb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.545355:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f600/0xad5b343a26574ccb lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.545408:0:22662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788840020.545498:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41172893-7edf-4e98-bf08-ce61943bc35d+23:2390:x1875734050277888:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 288us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840020.545562:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000040:00080000:0.0:1788840020.546479:0:22712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788840020.546706:0:22677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f600/0xad5b343a26574ccb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.546715:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f600/0xad5b343a26574ccb lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788840020.546734:0:22677:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788840020.546998:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4fa00/0xad5b343a26574cc4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f40 expref: 24 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.547019:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4f600/0xad5b343a26574ccb lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f40 expref: 23 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.547031:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:2.0:1788840020.547034:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788840020.547038:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4f600, rc 0) 00000100:00100000:2.0:1788840020.547103:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+23:18841:x1875734050277632:12345-192.168.203.52@tcp:101:dd.0 Request processed in 20119us (20414us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1788840020.547111:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1788840020.550102:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840020.550193:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050278016 00000100:00100000:2.0:1788840020.550203:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050278016 00000100:00100000:2.0:1788840020.550263:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1788840020.550398:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+23:18841:x1875734050278016:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:2.0:1788840020.550423:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840020.550444:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574cd9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f47 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.550477:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ce0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.550491:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ce0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.550500:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ce0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.550633:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574cd9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f47 expref: 25 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.550651:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ce0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f47 expref: 24 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.550659:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:2.0:1788840020.550662:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788840020.550665:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843400, rc 0) 00000100:00100000:2.0:1788840020.550737:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+24:18841:x1875734050278016:12345-192.168.203.52@tcp:101:dd.0 Request processed in 464us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840020.550744:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1788840020.554259:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840020.558428:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050278272 00000100:00100000:2.0:1788840020.558439:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050278272 00000100:00100000:2.0:1788840020.558629:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:2.0:1788840020.558642:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+24:18841:x1875734050278272:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:2.0:1788840020.560934:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.560956:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.560968:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788840020.561013:0:22676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1788840020.561043:0:22676:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad3021c3 reply state 00000000c824686c transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.561056:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.561063:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:2.0:1788840020.561066:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788840020.561070:0:22676:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788840020.561175:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+27:18841:x1875734050278272:12345-192.168.203.52@tcp:36:dd.0 Request processed in 2532us (6921us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788840020.561183:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000020:00080000:2.0:1788840020.561189:0:22676:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788840020.565272:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840020.565414:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050278400 00000100:00100000:3.0:1788840020.565424:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050278400 00000100:00100000:3.0:1788840020.565537:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1788840020.565550:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+27:18841:x1875734050278400:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:3.0:1788840020.565575:0:23418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788840020.565597:0:23418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574cee lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f4e expref: -99 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.565655:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574cee lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f4e expref: 28 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.565669:0:23418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574cee lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f4e expref: 28 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840020.565711:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:3.0:1788840020.565715:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788840020.565719:0:23418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958400, rc 0) 00000100:00100000:3.0:1788840020.565807:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+28:18841:x1875734050278400:12345-192.168.203.52@tcp:101:dd.0 Request processed in 260us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840020.565814:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1788840020.584094:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840020.584188:0:22664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050278656 00000100:00100000:0.0:1788840020.584197:0:22664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050278656 00000100:00100000:0.0:1788840020.584257:0:22664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1788840020.584267:0:22664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41172893-7edf-4e98-bf08-ce61943bc35d+28:18841:x1875734050278656:12345-192.168.203.52@tcp:103:dd.0 00010000:00010000:0.0:1788840020.584281:0:22664:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788840020.584305:0:22664:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26574cee lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f4e expref: 28 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840020.584322:0:22664:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:0.0:1788840020.584327:0:22664:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788840020.584475:0:22664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41172893-7edf-4e98-bf08-ce61943bc35d+27:18841:x1875734050278656:12345-192.168.203.52@tcp:103:dd.0 Request processed in 207us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840020.584483:0:22664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1788840020.597032:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840020.597136:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050278784 00000100:00100000:1.0:1788840020.597145:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050278784 00000100:00100000:1.0:1788840020.597204:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1788840020.597222:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+27:18841:x1875734050278784:12345-192.168.203.52@tcp:58:dd.0 00010000:00010000:1.0:1788840020.597334:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.597351:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840020.597362:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788840020.598706:0:22677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788840020.598738:0:22677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788840020.598937:0:22677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788840020.599042:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+27:18841:x1875734050278784:12345-192.168.203.52@tcp:58:dd.0 Request processed in 1818us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840020.599052:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:0.0:1788840020.612683:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840020.613330:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050278912 00000100:00100000:2.0:1788840020.613339:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050278912 00000100:00100000:2.0:1788840020.613394:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:2.0:1788840020.613406:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+27:18841:x1875734050278912:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:2.0:1788840020.613427:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840020.613447:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574cfc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f55 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.613503:0:22678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.613525:0:22678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574cfc lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f55 expref: 28 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.613545:0:22678:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.613558:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574cfc lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f55 expref: 28 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.613572:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:2.0:1788840020.613575:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788840020.613579:0:22678:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574cfc lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f55 expref: 28 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840020.613586:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842e00, rc 0) 00000100:00100000:2.0:1788840020.613645:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+28:18841:x1875734050278912:12345-192.168.203.52@tcp:101:dd.0 Request processed in 241us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840020.613651:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1788840020.864718:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788840020.864744:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060864384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788840020.864840:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840020.865022:0:24188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060864384 00000100:00100000:2.0:1788840020.865031:0:24188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060864384 00000100:00100000:2.0:1788840020.865099:0:24188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788840020.865109:0:24188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060864384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788840020.865140:0:24188:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788840020.865196:0:24188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060864384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840020.865203:0:24188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788840020.865297:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060864384:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788840020.865417:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788840021.159990:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.160032:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.160060:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.160078:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.160099:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.160113:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.160129:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.160141:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.160159:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.160178:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050279424 00000100:00100000:3.0:1788840021.160187:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050279424 00000100:00100000:3.0:1788840021.160230:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050279936 00000100:00100000:3.0:1788840021.160233:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050279936 00000100:00100000:3.0:1788840021.160245:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050279552 00000100:00100000:3.0:1788840021.160247:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050279552 00000100:00100000:3.0:1788840021.160257:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050280064 00000100:00100000:3.0:1788840021.160259:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050280064 00000100:00100000:3.0:1788840021.160272:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1788840021.160280:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41172893-7edf-4e98-bf08-ce61943bc35d+5:2389:x1875734050279424:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788840021.160350:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41172893-7edf-4e98-bf08-ce61943bc35d+5:2389:x1875734050279424:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 70us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.160358:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1788840021.160377:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1788840021.160388:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+5:2389:x1875734050279936:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788840021.160388:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1788840021.160406:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41172893-7edf-4e98-bf08-ce61943bc35d+5:2389:x1875734050279552:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788840021.160426:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+5:2389:x1875734050279936:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 42us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.160433:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1788840021.160447:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788840021.160455:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+5:2389:x1875734050280064:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788840021.160461:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41172893-7edf-4e98-bf08-ce61943bc35d+5:2389:x1875734050279552:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 59us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840021.160470:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788840021.160487:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+5:2389:x1875734050280064:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.160494:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788840021.160503:0:22669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050279040 00000100:00100000:1.0:1788840021.160509:0:22669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050279040 00000100:00100000:3.0:1788840021.160550:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050279168 00000100:00100000:3.0:1788840021.160554:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050279168 00000100:00100000:3.0:1788840021.160574:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050279680 00000100:00100000:3.0:1788840021.160576:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050279680 00000100:00100000:3.0:1788840021.160586:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050279296 00000100:00100000:3.0:1788840021.160587:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050279296 00000100:00100000:3.0:1788840021.160596:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050279808 00000100:00100000:3.0:1788840021.160598:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050279808 00000100:00100000:3.0:1788840021.160610:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1788840021.160615:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+28:2389:x1875734050279168:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788840021.160628:0:22669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:1.0:1788840021.160642:0:22669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+13:2389:x1875734050279040:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788840021.160644:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+28:2389:x1875734050279168:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.160664:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1788840021.160677:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1788840021.160683:0:22669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:176971ca-bf30-437e-868a-3adf0e6b2af5+13:2389:x1875734050279040:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 43us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.160689:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+12:2389:x1875734050279680:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788840021.160705:0:22669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:3.0:1788840021.160719:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+12:2389:x1875734050279680:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.160726:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:3.0:1788840021.160741:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:3.0:1788840021.160748:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+5:2389:x1875734050279296:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788840021.160751:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788840021.160764:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+5:2389:x1875734050279808:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788840021.160801:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+5:2389:x1875734050279296:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.160808:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1788840021.160824:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e7eeb6f-a098-4dd3-ab34-56852e5130f9+5:2389:x1875734050279808:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 63us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840021.160831:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00080000:0.0:1788840021.161109:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788840021.161114:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788840021.161116:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788840021.161118:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788840021.248126:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788840021.375324:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060864512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788840021.375399:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840021.375669:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060864512 00000100:00100000:2.0:1788840021.375680:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060864512 00000100:00100000:2.0:1788840021.375730:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788840021.375740:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060864512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788840021.375791:0:22681:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788840021.375841:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060864512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840021.375848:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788840021.375931:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060864512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788840021.381572:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788840021.382866:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060864640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788840021.382945:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840021.383204:0:23417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060864640 00000100:00100000:1.0:1788840021.383213:0:23417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060864640 00000100:00100000:1.0:1788840021.383272:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788840021.383280:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060864640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788840021.383313:0:23417:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788840021.383372:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060864640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840021.383379:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788840021.383745:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060864640:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788840021.566969:0:22712:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788840021.566977:0:22712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788840021.567001:0:22712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788840021.567008:0:22712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788840021.567123:0:22712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483df100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22712:1875734060864768:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788840021.567210:0:22712:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788840021.573100:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840021.573248:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050280192 00000100:00100000:1.0:1788840021.573257:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050280192 00000100:00100000:1.0:1788840021.573319:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:1.0:1788840021.573330:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+29:18842:x1875734050280192:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788840021.573362:0:23418:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788840021.573523:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+29:18842:x1875734050280192:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 194us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840021.573531:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1788840021.574911:0:22712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483df100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22712:1875734060864768:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788840021.578432:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840021.579056:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050280320 00000100:00100000:2.0:1788840021.579067:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050280320 00000100:00100000:2.0:1788840021.579134:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:2.0:1788840021.579145:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+28:18842:x1875734050280320:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788840021.579216:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d03 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579234:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579247:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579319:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579327:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579334:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579357:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d11 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579365:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579372:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788840021.579415:0:22678:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788840021.579419:0:22678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788840021.579431:0:22678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579441:0:22678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d03 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579448:0:22678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d03 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579454:0:22678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579469:0:22678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788840021.579474:0:22678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d03 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579481:0:22678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d03 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579493:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab646800000) 00010000:00010000:2.0:1788840021.579515:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788840021.579521:0:22678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d03 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579528:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d03 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579542:0:22678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579548:0:22678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d0a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579553:0:22678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579558:0:22678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788840021.579560:0:22678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579566:0:22678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d0a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579584:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8ab646800900) 00010000:00010000:2.0:1788840021.579587:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788840021.579589:0:22678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d0a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.579610:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d0a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.580128:0:22678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d11 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.580136:0:22678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d11 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.580142:0:22678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d11 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.580146:0:22678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788840021.580149:0:22678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d11 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.580155:0:22678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d11 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.580164:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:2.0:1788840021.580167:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788840021.580170:0:22678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d11 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.580176:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d11 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840021.580273:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+28:18842:x1875734050280320:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 1128us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840021.580282:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1788840021.582581:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840021.583109:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050280576 00000100:00100000:1.0:1788840021.583119:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050280576 00000100:00100000:1.0:1788840021.583192:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:1.0:1788840021.583202:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+28:18842:x1875734050280576:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788840021.583222:0:23418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788840021.583243:0:23418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e600/0xad5b343a26574d18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f5c expref: -99 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.583348:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574d1f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.583361:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574d1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.583371:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574d1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788840021.583381:0:23418:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788840021.583461:0:23418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574d1f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.583469:0:23418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574d1f lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.583476:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574d1f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.583499:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4e800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840021.583504:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574d1f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.583520:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574d1f lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.583544:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:1.0:1788840021.583547:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788840021.583551:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574d1f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.583558:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e800/0xad5b343a26574d1f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.583607:0:23418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e600/0xad5b343a26574d18 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f5c expref: 30 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.583619:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab646800000) 00010000:00010000:1.0:1788840021.583621:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788840021.584464:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e600/0xad5b343a26574d18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f5c expref: 30 pid: 23418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.584479:0:23418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab746e4e600, rc 0) 00000100:00100000:1.0:1788840021.585129:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+29:18842:x1875734050280576:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1925us (2553us total) trans 12884901907 rc 301/301 00000100:00100000:1.0:1788840021.585139:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1788840021.589742:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840021.591040:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050280704 00000100:00100000:2.0:1788840021.591054:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050280704 00000100:00100000:2.0:1788840021.591223:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1788840021.591234:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+29:18842:x1875734050280704:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788840021.591270:0:22676:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788840021.591407:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+29:18842:x1875734050280704:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 174us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840021.591414:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1788840021.594036:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840021.595413:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050280960 00000100:00100000:0.0:1788840021.595424:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050280960 00000100:00100000:0.0:1788840021.595484:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:0.0:1788840021.595500:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+29:18842:x1875734050280960:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788840021.595529:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788840021.595550:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23400/0xad5b343a26574d2d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f63 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788840021.596478:0:22678:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:0.0:1788840021.596486:0:22678:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:0.0:1788840021.597209:0:22678:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:0.0:1788840021.597392:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22000/0xad5b343a26574d34 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.597417:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22000/0xad5b343a26574d34 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.597428:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22000/0xad5b343a26574d34 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.597491:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23400/0xad5b343a26574d2d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f63 expref: 32 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.597676:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22000/0xad5b343a26574d34 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f63 expref: 31 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.597686:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:0.0:1788840021.597689:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788840021.597692:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab77dc22000, rc 0) 00000100:00100000:0.0:1788840021.597784:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+31:18842:x1875734050280960:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2275us (3739us total) trans 12884901908 rc 0/0 00000100:00100000:0.0:1788840021.597794:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:3.0:1788840021.601338:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840021.601523:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050281216 00000100:00100000:0.0:1788840021.601534:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050281216 00000100:00100000:0.0:1788840021.601597:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1788840021.601607:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+31:18842:x1875734050281216:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788840021.601692:0:23418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788840021.601731:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22000/0xad5b343a26574d34 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f63 expref: 31 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601749:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:0.0:1788840021.601786:0:23418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788840021.601806:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22c00/0xad5b343a26574d42 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601830:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22c00/0xad5b343a26574d42 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601840:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22c00/0xad5b343a26574d42 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601855:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d49 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xfa7b6860 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601862:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d49 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa7b6860 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601868:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d49 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa7b6860 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601918:0:23418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22c00/0xad5b343a26574d42 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601926:0:23418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22c00/0xad5b343a26574d42 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601932:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22c00/0xad5b343a26574d42 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601938:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc22c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788840021.601942:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22c00/0xad5b343a26574d42 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601949:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22c00/0xad5b343a26574d42 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601963:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ab647852800) 00010000:00010000:0.0:1788840021.601966:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788840021.601970:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22c00/0xad5b343a26574d42 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601976:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22c00/0xad5b343a26574d42 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601985:0:23418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d49 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa7b6860 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601991:0:23418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d49 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa7b6860 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.601997:0:23418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d49 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa7b6860 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.602002:0:23418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc23200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788840021.602005:0:23418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d49 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa7b6860 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.602011:0:23418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d49 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xfa7b6860 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.602018:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xfa7b6860 (ffff8ab777ad0000) 00010000:00010000:0.0:1788840021.602020:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788840021.602023:0:23418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d49 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xfa7b6860 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.602029:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d49 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xfa7b6860 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840021.602476:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+30:18842:x1875734050281216:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 867us (1143us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788840021.602485:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:3.0:1788840021.608571:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840021.608733:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050281344 00000100:00100000:2.0:1788840021.608742:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050281344 00000100:00100000:2.0:1788840021.609035:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:2.0:1788840021.609047:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+30:18842:x1875734050281344:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788840021.609081:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840021.609103:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d50 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f6a expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.609137:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d57 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.609150:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d57 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.609157:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d57 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.609252:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d50 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f6a expref: 32 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.609264:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842200/0xad5b343a26574d57 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f6a expref: 31 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.609270:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab646800900) 00010000:00010000:2.0:1788840021.609272:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788840021.609275:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842200, rc 0) 00000100:00100000:2.0:1788840021.609393:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+31:18842:x1875734050281344:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 348us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840021.609399:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:2.0:1788840021.612690:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840021.613324:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050281600 00000100:00100000:0.0:1788840021.613335:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050281600 00000100:00100000:0.0:1788840021.613404:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:0.0:1788840021.613414:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+31:18842:x1875734050281600:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788840021.613516:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.613534:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.613546:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788840021.615109:0:23418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1788840021.615128:0:23418:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676559356679ns, next at 677559353725ns, rc = 0 00000004:00010000:0.0:1788840021.615198:0:23418:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f28a735e reply state 000000008e803ad8 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.615216:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.615225:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab646800900) 00010000:00010000:0.0:1788840021.615227:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788840021.615232:0:23418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788840021.615394:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+33:18842:x1875734050281600:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1978us (2710us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788840021.615419:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:0.0:1788840021.618026:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840021.618127:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050281728 00000100:00100000:2.0:1788840021.618136:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050281728 00000100:00100000:2.0:1788840021.618204:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:2.0:1788840021.618215:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+33:18842:x1875734050281728:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788840021.618246:0:22676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840021.618276:0:22676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d65 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f71 expref: -99 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.618361:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d65 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f71 expref: 34 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.618382:0:22676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d65 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f71 expref: 34 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.618435:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab646800900) 00010000:00010000:2.0:1788840021.618438:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788840021.618442:0:22676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842400, rc 0) 00000100:00100000:2.0:1788840021.618608:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+34:18842:x1875734050281728:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 393us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840021.618615:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:3.0:1788840021.621160:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840021.621297:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050281856 00000100:00100000:1.0:1788840021.621306:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050281856 00000100:00100000:1.0:1788840021.621358:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1788840021.621368:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41172893-7edf-4e98-bf08-ce61943bc35d+5:2390:x1875734050281856:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788840021.621619:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41172893-7edf-4e98-bf08-ce61943bc35d+6:2390:x1875734050281856:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 250us (465us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1788840021.621635:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788840021.623898:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840021.624113:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050282112 00000100:00100000:1.0:1788840021.624122:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050282112 00000100:00100000:1.0:1788840021.624179:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1788840021.624188:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+34:18842:x1875734050282112:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788840021.624385:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+35:18842:x1875734050282112:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 198us (495us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1788840021.624393:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788840021.627036:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840021.627278:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050282368 00000100:00100000:1.0:1788840021.627288:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050282368 00000100:00100000:1.0:1788840021.627383:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788840021.627393:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+35:18842:x1875734050282368:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788840021.627499:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+35:18842:x1875734050282368:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 107us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840021.627516:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:3.0:1788840021.629916:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840021.630092:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050282496 00000100:00100000:2.0:1788840021.630101:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050282496 00000100:00100000:2.0:1788840021.630161:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1788840021.630171:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+35:18842:x1875734050282496:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788840021.630189:0:22678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840021.630210:0:22678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26574d6c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f78 expref: -99 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.630278:0:22678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d73 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.630297:0:22678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.630309:0:22678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788840021.630352:0:22678:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788840021.630375:0:22678:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d73 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22678 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.630400:0:22678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26574d6c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f78 expref: 37 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.630430:0:22678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d73 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f78 expref: 36 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.630438:0:22678:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab646800900) 00010000:00010000:2.0:1788840021.630441:0:22678:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788840021.630444:0:22678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843800, rc 0) 00000100:00100000:2.0:1788840021.630611:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+36:18842:x1875734050282496:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 440us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840021.630618:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:3.0:1788840021.637127:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840021.637806:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050282624 00000100:00100000:0.0:1788840021.637815:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050282624 00000100:00100000:0.0:1788840021.637897:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1788840021.637907:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41172893-7edf-4e98-bf08-ce61943bc35d+6:2390:x1875734050282624:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788840021.637926:0:24183:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788840021.637946:0:24183:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075cda88e/0xad5b343a26574d7a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f7f expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788840021.637969:0:24183:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f8854, blocks: 0x0 00010000:00010000:0.0:1788840021.637986:0:24183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=676s v=(0 0) 00010000:00010000:0.0:1788840021.637990:0:24183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840021.637998:0:24183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075cda88e/0xad5b343a26574d7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f7f expref: 7 pid: 24183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.638016:0:24183:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000075cda88e/0xad5b343a26574d7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f7f expref: 7 pid: 24183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.638030:0:24183:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab77dc23400, rc 0) 00000100:00100000:0.0:1788840021.638086:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41172893-7edf-4e98-bf08-ce61943bc35d+7:2390:x1875734050282624:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 179us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840021.638093:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1788840021.642269:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.642369:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050282880 00000100:00100000:3.0:1788840021.642379:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050282880 00000100:00100000:3.0:1788840021.642433:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1788840021.642444:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+36:18842:x1875734050282880:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788840021.642566:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+36:18842:x1875734050282880:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 123us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.642573:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:2.0:1788840021.646005:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.646097:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050283008 00000100:00100000:3.0:1788840021.646107:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050283008 00000100:00100000:1.0:1788840021.646200:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1788840021.646211:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+36:18842:x1875734050283008:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788840021.651619:0:22657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1788840021.651637:0:22657:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788840021.651678:0:22657:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1788840021.651947:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788840021.651966:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060864896:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788840021.652027:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840021.652074:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060864896 00000100:00100000:2.0:1788840021.652081:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060864896 00000100:00100000:2.0:1788840021.652148:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788840021.652158:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060864896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788840021.652283:0:25205:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788840021.652287:0:25205:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788840021.652289:0:25205:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788840021.652291:0:25205:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788840020 -> 1788840020 00002000:00010000:2.0:1788840021.652294:0:25205:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788840021.652334:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060864896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 177us (307us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788840021.652342:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788840021.652375:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788840021.652405:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab777eec700/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788840021.652411:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060864896:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788840021.654828:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.654847:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.654854:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.654861:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840021.654865:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.654886:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.654914:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ab647852800) 00010000:00010000:1.0:1788840021.654917:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788840021.654923:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.654928:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574c07 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840021.655080:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41172893-7edf-4e98-bf08-ce61943bc35d+19:18842:x1875734050283008:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 8867us (9081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840021.655090:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00010000:00010000:1.0:1788840021.658390:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658408:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658416:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658423:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840021.658427:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658433:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658474:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8ab647852700) 00010000:00010000:1.0:1788840021.658477:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840021.658482:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658488:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26574bb3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658521:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658528:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658533:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658537:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840021.658539:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658545:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658552:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8ab647852800) 00010000:00010000:1.0:1788840021.658554:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840021.658557:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658563:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26574bba lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658587:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658593:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658598:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658603:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840021.658606:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658612:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658620:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8ab647852e00) 00010000:00010000:1.0:1788840021.658633:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840021.658637:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658643:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959800/0xad5b343a26574c62 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658657:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658663:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658669:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658685:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788840021.658688:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658694:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658703:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:1.0:1788840021.658705:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788840021.658707:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658712:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26574ce7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658725:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658731:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658737:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.658742:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc23200 already unused, calling callback (ffffffffc19974f0) 00000100:00100000:2.0:1788840021.658856:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:1.0:1788840021.659012:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.659019:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.659038:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab646800900) 00010000:00010000:1.0:1788840021.659040:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788840021.659043:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.659048:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc23200/0xad5b343a26574d5e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840021.659142:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050283136 00000100:00100000:0.0:1788840021.659152:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050283136 00000100:00100000:0.0:1788840021.659193:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788840021.659203:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41172893-7edf-4e98-bf08-ce61943bc35d+7:2389:x1875734050283136:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788840021.659306:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41172893-7edf-4e98-bf08-ce61943bc35d+7:2389:x1875734050283136:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 104us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840021.659313:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788840021.662327:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.663165:0:23418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050283392 00000100:00100000:3.0:1788840021.663178:0:23418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050283392 00000100:00100000:2.0:1788840021.663353:0:23418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:2.0:1788840021.663364:0:23418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+15:18842:x1875734050283392:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788840021.663422:0:23418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788840021.663447:0:23418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574d73 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f78 expref: 15 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.663466:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab646800900) 00010000:00010000:2.0:1788840021.663471:0:23418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788840021.663518:0:23418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574d81 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.663532:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574d81 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.663542:0:23418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574d81 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788840021.663685:0:23418:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000255e5354 reply state 00000000c476a79b transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574d81 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.663698:0:23418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26574d81 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.663704:0:23418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab646800900) 00010000:00010000:2.0:1788840021.663707:0:23418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788840021.663721:0:23418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788840021.663853:0:23418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41172893-7edf-4e98-bf08-ce61943bc35d+16:18842:x1875734050283392:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 490us (1533us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788840021.663860:0:23418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:0.0:1788840021.667704:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840021.667905:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050283520 00000100:00100000:2.0:1788840021.667915:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050283520 00000100:00100000:2.0:1788840021.667962:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788840021.667972:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41172893-7edf-4e98-bf08-ce61943bc35d+7:2389:x1875734050283520:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788840021.668118:0:25205:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788840021.668121:0:25205:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788840019 00002000:00010000:2.0:1788840021.668124:0:25205:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788840019 00002000:00010000:2.0:1788840021.668126:0:25205:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788840020 -> 1788840019 00002000:00010000:2.0:1788840021.668128:0:25205:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788840021.668191:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41172893-7edf-4e98-bf08-ce61943bc35d+8:2389:x1875734050283520:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 221us (496us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788840021.668198:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:3.0:1788840021.672339:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840021.672410:0:24183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050283648 00000100:00100000:0.0:1788840021.672419:0:24183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050283648 00000100:00100000:0.0:1788840021.672639:0:24183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:0.0:1788840021.672650:0:24183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78132ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41172893-7edf-4e98-bf08-ce61943bc35d+8:2390:x1875734050283648:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788840021.672693:0:24183:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574d88 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.672710:0:24183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840021.672714:0:24183:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840021.672720:0:24183:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574d88 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.672734:0:24183:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574d88 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.672796:0:24183:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574d88 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.672826:0:24183:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574d88 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.672834:0:24183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574d88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.672841:0:24183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc22200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788840021.672845:0:24183:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574d88 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.672855:0:24183:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574d88 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.672870:0:24183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574d88 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.672878:0:24183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574d88 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24183 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840021.672940:0:24183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78132ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41172893-7edf-4e98-bf08-ce61943bc35d+8:2390:x1875734050283648:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 292us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840021.672947:0:24183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788840021.675006:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.675239:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050283904 00000100:00100000:3.0:1788840021.675249:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050283904 00000100:00100000:3.0:1788840021.675307:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:3.0:1788840021.675327:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+16:18842:x1875734050283904:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788840021.675407:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.675424:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ce0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f47 expref: 16 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.675449:0:22676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.675485:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ce0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f47 expref: 16 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.675516:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ce0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f47 expref: 16 pid: 22678 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840021.675531:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648265880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22676:1875734060865024:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788840021.675612:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746ddc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788840021.678676:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648265880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22676:1875734060865024:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788840021.678676:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:3.0:1788840021.678703:0:22676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840021.679222:0:22662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050284032 00000100:00100000:2.0:1788840021.679230:0:22662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050284032 00010000:00010000:2.0:1788840021.679268:0:22662:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ce0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f47 expref: 17 pid: 22678 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840021.679352:0:22662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1788840021.679362:0:22662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41172893-7edf-4e98-bf08-ce61943bc35d+17:2389:x1875734050284032:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788840021.679377:0:22662:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788840021.679384:0:22662:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ce0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f47 expref: 17 pid: 22678 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.679415:0:22662:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ce0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f47 expref: 17 pid: 22678 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.679437:0:22662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574ce0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f47 expref: 17 pid: 22678 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.679461:0:22662:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:2.0:1788840021.679467:0:22662:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574cfc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f55 expref: 16 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.679476:0:22662:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.679483:0:22662:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.679491:0:22662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.679527:0:22662:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788840021.679584:0:22662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41172893-7edf-4e98-bf08-ce61943bc35d+16:2389:x1875734050284032:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 224us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840021.679592:0:22662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00010000:00010000:0.0:1788840021.679640:0:22676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.679659:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.680281:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.680294:0:22676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d65 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f71 expref: 16 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.680301:0:22676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.680329:0:22676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d65 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f71 expref: 16 pid: 22676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.680342:0:22676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d65 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f71 expref: 16 pid: 22676 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840021.680354:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22676:1875734060865152:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788840021.680423:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788840021.682987:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.683181:0:23433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050284160 00000100:00100000:3.0:1788840021.683190:0:23433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050284160 00010000:00010000:3.0:1788840021.683223:0:23433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d65 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f71 expref: 17 pid: 22676 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840021.683264:0:23433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788840021.683272:0:23433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41172893-7edf-4e98-bf08-ce61943bc35d+17:2389:x1875734050284160:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788840021.683285:0:23433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788840021.683291:0:23433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d65 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f71 expref: 17 pid: 22676 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.683322:0:23433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d65 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f71 expref: 17 pid: 22676 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.683344:0:23433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab646800900) 00010000:00010000:3.0:1788840021.683350:0:23433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.683359:0:23433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.683367:0:23433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.683381:0:23433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788840021.683424:0:23433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41172893-7edf-4e98-bf08-ce61943bc35d+17:2389:x1875734050284160:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 153us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.683431:0:23433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00010000:00010000:0.0:1788840021.685169:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842400/0xad5b343a26574d65 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f71 expref: 16 pid: 22676 timeout: 776 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840021.685192:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22676:1875734060865152:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788840021.685213:0:22676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.685232:0:22676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.685251:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788840021.685337:0:22676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1788840021.685420:0:22676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1788840021.685451:0:22676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1788840021.685729:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22676:1875734060865280:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788840021.685868:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840021.685901:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74674f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788840021.685991:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060865280 00000100:00100000:3.0:1788840021.685998:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060865280 00000100:00100000:3.0:1788840021.686082:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788840021.686092:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22676:x1875734060865280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788840021.686208:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22676:x1875734060865280:12345-0@lo:1000:mdt00_000.0 Request processed in 117us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.686215:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788840021.686275:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22676:1875734060865280:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788840021.686410:0:22676:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788840021.686452:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22676:1875734060865408:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788840021.686478:0:22676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840021.686546:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74674f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788840021.686726:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060865408 00000100:00100000:2.0:1788840021.686732:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060865408 00000100:00100000:1.0:1788840021.686842:0:23417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788840021.686854:0:23417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22676:x1875734060865408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788840021.687013:0:23417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22676:x1875734060865408:12345-0@lo:1000:mdt00_000.0 Request processed in 163us (533us total) trans 12884901894 rc 0/0 00000100:00100000:1.0:1788840021.687020:0:23417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788840021.687143:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483ddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22676:1875734060865408:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788840021.687175:0:22676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687185:0:22676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687193:0:22676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687198:0:22676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc22600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788840021.687202:0:22676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687219:0:22676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687232:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab646800900) 00010000:00010000:0.0:1788840021.687235:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788840021.687239:0:22676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687244:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22600/0xad5b343a26574d96 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687271:0:22676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687276:0:22676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687281:0:22676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687285:0:22676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab746e4e400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788840021.687288:0:22676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687292:0:22676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687299:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:0.0:1788840021.687301:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788840021.687307:0:22676:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574cfc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f55 expref: 19 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687327:0:22676:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574cfc lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f55 expref: 19 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687335:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574cfc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f55 expref: 19 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.687382:0:22676:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26574cfc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f55 expref: 19 pid: 22678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840021.687393:0:22676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22676:1875734060865536:192.168.203.52@tcp:105: 00000100:00100000:0.0:1788840021.687489:0:22676:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74674f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788840021.691367:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.691444:0:22679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050284288 00000100:00100000:3.0:1788840021.691454:0:22679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050284288 00000100:00100000:3.0:1788840021.691523:0:22679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1788840021.691532:0:22679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+20:18841:x1875734050284288:12345-192.168.203.52@tcp:49:dd.0 00000100:00100000:3.0:1788840021.691873:0:22679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41172893-7edf-4e98-bf08-ce61943bc35d+20:18841:x1875734050284288:12345-192.168.203.52@tcp:49:dd.0 Request processed in 341us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.691881:0:22679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788840021.692209:0:22676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22676:1875734060865536:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788840021.692234:0:22676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692245:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab746e4e400/0xad5b343a26574cf5 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692277:0:22676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22200/0xad5b343a26574d9d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692291:0:22676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22200/0xad5b343a26574d9d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692301:0:22676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22200/0xad5b343a26574d9d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692310:0:22676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22200/0xad5b343a26574d9d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692326:0:22676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22200/0xad5b343a26574d9d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692332:0:22676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22200/0xad5b343a26574d9d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692337:0:22676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc22200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788840021.692341:0:22676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22200/0xad5b343a26574d9d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692348:0:22676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22200/0xad5b343a26574d9d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692359:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:0.0:1788840021.692362:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788840021.692365:0:22676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22200/0xad5b343a26574d9d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692370:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab77dc22200/0xad5b343a26574d9d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692381:0:22676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692386:0:22676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692391:0:22676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692406:0:22676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788840021.692415:0:22676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692422:0:22676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692432:0:22676:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:0.0:1788840021.692434:0:22676:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788840021.692437:0:22676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.692443:0:22676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574d8f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22676 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840021.692644:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41172893-7edf-4e98-bf08-ce61943bc35d+19:18842:x1875734050283904:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 17326us (17648us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1788840021.692653:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000020:00080000:0.0:1788840021.692657:0:22676:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788840021.693589:0:22712:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788840021.693596:0:22712:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788840021.693614:0:22712:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788840021.693626:0:22712:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788840021.694937:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840021.695066:0:22680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050284544 00000100:00100000:2.0:1788840021.695075:0:22680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050284544 00000100:00100000:2.0:1788840021.695127:0:22680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788840021.695137:0:22680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41172893-7edf-4e98-bf08-ce61943bc35d+19:18842:x1875734050284544:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788840021.695474:0:22680:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788840021.695515:0:22680:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1788840021.695549:0:22680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574da4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.695564:0:22680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574da4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.695575:0:22680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574da4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.695583:0:22680:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574da4 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.695589:0:22680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574da4 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.695595:0:22680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574da4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.695617:0:22680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788840021.695699:0:22680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41172893-7edf-4e98-bf08-ce61943bc35d+21:18842:x1875734050284544:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 563us (767us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1788840021.695707:0:22680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000020:00080000:2.0:1788840021.695711:0:22680:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788840021.695887:0:22666:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788840021.695894:0:22666:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574da4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.695901:0:22666:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840021.695906:0:22666:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574da4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.695913:0:22666:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574da4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.695938:0:22666:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8ab646800900) 00010000:00010000:1.0:1788840021.695941:0:22666:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788840021.695946:0:22666:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574da4 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.695951:0:22666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843800/0xad5b343a26574da4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22680 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.695964:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840021.695965:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788840021.695967:0:22666:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788840021.697866:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788840021.698162:0:22677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050284672 00000100:00100000:2.0:1788840021.698184:0:22677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050284672 00000100:00100000:2.0:1788840021.698240:0:22677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1788840021.698251:0:22677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+21:18841:x1875734050284672:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:2.0:1788840021.698275:0:22677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788840021.698295:0:22677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574dab lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74f86 expref: -99 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.698329:0:22677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574db2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.698341:0:22677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574db2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.698352:0:22677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574db2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.698615:0:22677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26574dab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f86 expref: 23 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.698634:0:22677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26574db2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f86 expref: 22 pid: 22677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.698644:0:22677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8ab647852600) 00010000:00010000:2.0:1788840021.698647:0:22677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788840021.698650:0:22677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843c00, rc 0) 00000100:00100000:2.0:1788840021.698709:0:22677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41172893-7edf-4e98-bf08-ce61943bc35d+22:18841:x1875734050284672:12345-192.168.203.52@tcp:101:dd.0 Request processed in 460us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840021.698715:0:22677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1788840021.824866:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788840021.824989:0:24189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050284800 00000100:00100000:0.0:1788840021.824999:0:24189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050284800 00000100:00100000:0.0:1788840021.825068:0:24189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788840021.825078:0:24189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41172893-7edf-4e98-bf08-ce61943bc35d+8:2392:x1875734050284800:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:0.0:1788840021.825111:0:24189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.825130:0:24189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075cda88e/0xad5b343a26574d7a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f7f expref: 8 pid: 24183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.825138:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840021.825156:0:24189:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788840021.825160:0:24189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.825196:0:24189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075cda88e/0xad5b343a26574d7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f7f expref: 8 pid: 24183 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.825210:0:24189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075cda88e/0xad5b343a26574d7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f7f expref: 8 pid: 24183 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840021.825225:0:24189:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24189:1875734060865664:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788840021.825302:0:24189:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74674f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788840021.829238:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788840021.829465:0:24191:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788840021.829474:0:24191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788840021.830006:0:24191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050284928 00000100:00100000:1.0:1788840021.830015:0:24191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050284928 00000100:00100000:3.0:1788840021.830513:0:25725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:3.0:1788840021.830525:0:25725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41172893-7edf-4e98-bf08-ce61943bc35d+9:2392:x1875734050284928:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:3.0:1788840021.830557:0:25725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.830575:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840021.830579:0:25725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840021.830585:0:25725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.830596:0:25725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788840021.830684:0:24189:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24189:1875734060865664:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788840021.830707:0:24189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840021.833116:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788840021.833191:0:22663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050285056 00000100:00100000:3.0:1788840021.833202:0:22663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050285056 00010000:00010000:3.0:1788840021.833243:0:22663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075cda88e/0xad5b343a26574d7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f7f expref: 10 pid: 24183 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788840021.833287:0:22663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788840021.833296:0:22663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41172893-7edf-4e98-bf08-ce61943bc35d+10:2390:x1875734050285056:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788840021.833312:0:22663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788840021.833346:0:22663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075cda88e/0xad5b343a26574d7a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f7f expref: 10 pid: 24183 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.833361:0:22663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075cda88e/0xad5b343a26574d7a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f7f expref: 10 pid: 24183 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.833384:0:22663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075cda88e/0xad5b343a26574d7a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74f7f expref: 10 pid: 24183 timeout: 776 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.833401:0:22663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840021.833405:0:22663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840021.833411:0:22663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.833421:0:22663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.833431:0:22663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840021.833433:0:22663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788840021.833438:0:22663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.833446:0:22663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.833713:0:25725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788840021.833723:0:25725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788840021.834370:0:22663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788840021.834429:0:22663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41172893-7edf-4e98-bf08-ce61943bc35d+9:2390:x1875734050285056:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1130us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788840021.834446:0:22663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00010000:00010000:1.0:1788840021.836218:0:24189:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.836238:0:24189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788840021.909135:0:24180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:0.0:1788840021.909154:0:24180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:1.0:1788840021.909379:0:25725:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:1.0:1788840021.909383:0:25725:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788840019 -> 1788840021 00002000:00010000:1.0:1788840021.909386:0:25725:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788840019 -> 1788840021 00002000:00010000:1.0:1788840021.909388:0:25725:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:1.0:1788840021.909406:0:25725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.909441:0:25725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.909450:0:25725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.909458:0:25725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788840021.909463:0:25725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.909472:0:25725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.909493:0:25725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788840021.909629:0:25725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000132f0bca/0xad5b343a26574dc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788840021.909736:0:25725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:41172893-7edf-4e98-bf08-ce61943bc35d+7:2392:x1875734050284928:12345-192.168.203.52@tcp:4:dd.0 Request processed in 79208us (80501us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788840021.909748:0:25725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000001:00080000:0.0:1788840021.951456:0:24180:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:2.0:1788840021.951686:0:24189:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1788840021.951715:0:24189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.951729:0:24189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.951738:0:24189:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.951745:0:24189:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab77dc22200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788840021.951750:0:24189:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.951759:0:24189:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.951793:0:24189:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788840021.951802:0:24189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef4eb2c9/0xad5b343a26574db9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788840021.951906:0:24189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:41172893-7edf-4e98-bf08-ce61943bc35d+5:2392:x1875734050284800:12345-192.168.203.52@tcp:4:dd.0 Request processed in 126824us (127044us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788840021.951921:0:24189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00010000:00010000:1.0:1788840022.271756:0:25212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788840022.399044:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060865792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788840022.399112:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788840022.399913:0:23431:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788840022.399975:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788840022.399986:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060865920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788840022.400023:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840022.400364:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060865792 00000100:00100000:0.0:1788840022.400382:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060865792 00000100:00100000:0.0:1788840022.400438:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060865920 00000100:00100000:0.0:1788840022.400441:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060865920 00000100:00100000:0.0:1788840022.400459:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788840022.400467:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060865792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788840022.400511:0:24187:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788840022.400562:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060865792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840022.400569:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788840022.400584:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788840022.400590:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060865920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788840022.400600:0:24187:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788840022.400625:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060865920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840022.400631:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788840022.400674:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060865792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788840022.401052:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060865920:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788840022.401072:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788840022.401433:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060866176:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.401473:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840022.401616:0:22682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060866176 00000100:00100000:1.0:1788840022.401622:0:22682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060866176 00000100:00100000:1.0:1788840022.401665:0:22682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788840022.401693:0:22682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060866176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.401737:0:22682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060866176:12345-0@lo:400:kworker.0 Request processed in 55us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840022.401744:0:22682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788840022.401794:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060866048:0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.401824:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840022.401850:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060866560:0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.401873:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840022.401891:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060867072:0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.401915:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840022.401935:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788840022.401940:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060866432:0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.401960:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840022.401974:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060866944:0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.401993:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840022.402007:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060867456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788840022.402027:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788840022.402050:0:22681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060866560 00000100:00100000:1.0:1788840022.402054:0:22681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060866560 00000100:00100000:1.0:1788840022.402077:0:22681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788840022.402083:0:22681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060866560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.402119:0:22681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060866560:12345-0@lo:400:kworker.0 Request processed in 36us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840022.402126:0:22681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788840022.402155:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060866560:0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.402183:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060867072 00000100:00100000:1.0:1788840022.402186:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060867072 00000100:00080000:1.0:1788840022.402203:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788840022.402226:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060866432 00000100:00100000:1.0:1788840022.402229:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060866432 00000100:00100000:1.0:1788840022.402241:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060866944 00000100:00100000:1.0:1788840022.402243:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060866944 00000100:00080000:1.0:1788840022.402254:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788840022.402268:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788840022.402275:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060867072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.402310:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060867072:12345-0@lo:400:kworker.0 Request processed in 36us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840022.402316:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788840022.402342:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478ad880 x1875734060867072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788840022.402353:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060867072:0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.402369:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788840022.402375:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060866432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.402406:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060866432:12345-0@lo:400:kworker.0 Request processed in 32us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840022.402412:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788840022.402450:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060866432:0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.402467:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788840022.402473:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060866944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.402522:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060866944:12345-0@lo:400:kworker.0 Request processed in 49us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840022.402537:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788840022.402560:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060866944:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.403492:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060866176:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.403519:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060866688:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.403562:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840022.403595:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060867200:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.403617:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840022.403711:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788840022.403718:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060866304:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.403740:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788840022.403759:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060866816:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.403801:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788840022.403865:0:22670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060866048 00000100:00100000:0.0:1788840022.403872:0:22670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060866048 00000100:00100000:0.0:1788840022.403918:0:22670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788840022.403926:0:22670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64781f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3617:x1875734060866048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840022.403970:0:22670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64781f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e+24:3617:x1875734060866048:12345-0@lo:400:kworker.0 Request processed in 45us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840022.403977:0:22670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788840022.404010:0:24187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060867456 00000100:00100000:0.0:1788840022.404014:0:24187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060867456 00000100:00100000:0.0:1788840022.404038:0:24187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788840022.404044:0:24187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060867456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788840022.404076:0:24187:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3915853824 avail 3684331520 00000100:00100000:0.0:1788840022.404109:0:24187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060867456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840022.404116:0:24187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788840022.404184:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060866688 00000100:00100000:1.0:1788840022.404190:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060866688 00000100:00100000:1.0:1788840022.404229:0:24185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060866304 00000100:00100000:1.0:1788840022.404232:0:24185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060866304 00000100:00100000:1.0:1788840022.404252:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788840022.404259:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060866688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.404295:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648267800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060866688:12345-0@lo:400:kworker.0 Request processed in 37us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840022.404300:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788840022.404311:0:24185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788840022.404316:0:24185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060866304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788840022.404339:0:24185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060866304:12345-0@lo:400:kworker.0 Request processed in 24us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788840022.404343:0:24185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788840022.404360:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788840022.404381:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:1.0:1788840022.404385:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab777eec700, transno 12884901892 00000004:00080000:1.0:1788840022.404394:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:1.0:1788840022.404413:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060867456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788840022.404423:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4e2ac6e9-f4ef-4f98-bf8f-e05da92b174e:3617:1875734060866048:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.406829:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060867328:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.406900:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788840022.407620:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060867200 00000100:00100000:2.0:1788840022.407630:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060867200 00000100:00080000:2.0:1788840022.407807:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788840022.407847:0:22678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060866816 00000100:00100000:2.0:1788840022.407850:0:22678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060866816 00000100:00100000:2.0:1788840022.407868:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788840022.407875:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060867200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840022.407938:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060867200:12345-0@lo:400:kworker.0 Request processed in 64us (4320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840022.407945:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788840022.407962:0:22678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788840022.407968:0:22678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060866816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788840022.407996:0:22678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060866816:12345-0@lo:400:kworker.0 Request processed in 28us (4195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788840022.408001:0:22678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788840022.408207:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060866688:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.408220:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060867200:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.408241:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060866304:0@lo:400:kworker.0 00000100:00100000:3.0:1788840022.408251:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060866816:0@lo:400:kworker.0 00000100:00100000:0.0:1788840022.408807:0:22676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060867328 00000100:00100000:0.0:1788840022.408813:0:22676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060867328 00000100:00100000:0.0:1788840022.408876:0:22676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788840022.408883:0:22676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060867328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788840022.408931:0:22676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060867328:12345-0@lo:400:kworker.0 Request processed in 50us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788840022.408937:0:22676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1788840022.409447:0:22673:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788840022.409477:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478ad500 x1875734060867328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788840038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788840022.409642:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060867328:0@lo:400:kworker.0 00010000:00010000:1.0:1788840023.295089:0:25213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788840023.568161:0:25763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788840024.319341:0:22665:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13867 lines, 13867 kept, 0 dropped, 0 bad.